2023-07-15 22:10:55,935 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-07-15 22:10:56,189 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97e758c6-fe86-0ed9-092f-cd0594d33e04 2023-07-15 22:10:56,190 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestSecureExportSnapshot timeout: 13 mins 2023-07-15 22:10:56,231 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-15 22:10:56,461 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-15 22:10:56,462 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97e758c6-fe86-0ed9-092f-cd0594d33e04/cluster_fd3e249f-a612-98a2-a131-09cf78600e25, deleteOnExit=true 2023-07-15 22:10:56,462 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-15 22:10:56,463 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97e758c6-fe86-0ed9-092f-cd0594d33e04/test.cache.data in system properties and HBase conf 2023-07-15 22:10:56,463 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97e758c6-fe86-0ed9-092f-cd0594d33e04/hadoop.tmp.dir in system properties and HBase conf 2023-07-15 22:10:56,464 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97e758c6-fe86-0ed9-092f-cd0594d33e04/hadoop.log.dir in system properties and HBase conf 2023-07-15 22:10:56,464 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97e758c6-fe86-0ed9-092f-cd0594d33e04/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-15 22:10:56,465 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97e758c6-fe86-0ed9-092f-cd0594d33e04/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-15 22:10:56,465 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-15 22:10:56,774 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-15 22:10:56,781 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97e758c6-fe86-0ed9-092f-cd0594d33e04/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-15 22:10:56,782 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97e758c6-fe86-0ed9-092f-cd0594d33e04/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-15 22:10:56,782 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97e758c6-fe86-0ed9-092f-cd0594d33e04/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-15 22:10:56,783 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97e758c6-fe86-0ed9-092f-cd0594d33e04/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-15 22:10:56,783 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97e758c6-fe86-0ed9-092f-cd0594d33e04/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-15 22:10:56,783 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97e758c6-fe86-0ed9-092f-cd0594d33e04/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-15 22:10:56,784 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97e758c6-fe86-0ed9-092f-cd0594d33e04/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-15 22:10:56,784 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97e758c6-fe86-0ed9-092f-cd0594d33e04/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-15 22:10:56,785 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97e758c6-fe86-0ed9-092f-cd0594d33e04/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-15 22:10:56,785 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97e758c6-fe86-0ed9-092f-cd0594d33e04/nfs.dump.dir in system properties and HBase conf 2023-07-15 22:10:56,786 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97e758c6-fe86-0ed9-092f-cd0594d33e04/java.io.tmpdir in system properties and HBase conf 2023-07-15 22:10:56,786 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97e758c6-fe86-0ed9-092f-cd0594d33e04/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-15 22:10:56,788 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97e758c6-fe86-0ed9-092f-cd0594d33e04/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-15 22:10:56,788 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97e758c6-fe86-0ed9-092f-cd0594d33e04/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-15 22:10:57,430 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-15 22:10:57,434 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-15 22:10:57,701 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-15 22:10:57,887 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-15 22:10:57,900 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-15 22:10:57,939 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-15 22:10:57,969 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97e758c6-fe86-0ed9-092f-cd0594d33e04/java.io.tmpdir/Jetty_localhost_36955_hdfs____.fsykn4/webapp 2023-07-15 22:10:58,121 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36955 2023-07-15 22:10:58,172 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-15 22:10:58,172 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-15 22:10:58,815 WARN [Listener at localhost/33847] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-15 22:10:58,915 WARN [Listener at localhost/33847] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-15 22:10:58,942 WARN [Listener at localhost/33847] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-15 22:10:58,950 INFO [Listener at localhost/33847] log.Slf4jLog(67): jetty-6.1.26 2023-07-15 22:10:58,957 INFO [Listener at localhost/33847] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97e758c6-fe86-0ed9-092f-cd0594d33e04/java.io.tmpdir/Jetty_localhost_34527_datanode____uygtr4/webapp 2023-07-15 22:10:59,128 INFO [Listener at localhost/33847] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34527 2023-07-15 22:10:59,599 WARN [Listener at localhost/39415] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-15 22:10:59,661 WARN [Listener at localhost/39415] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-15 22:10:59,667 WARN [Listener at localhost/39415] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-15 22:10:59,669 INFO [Listener at localhost/39415] log.Slf4jLog(67): jetty-6.1.26 2023-07-15 22:10:59,679 INFO [Listener at localhost/39415] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97e758c6-fe86-0ed9-092f-cd0594d33e04/java.io.tmpdir/Jetty_localhost_36575_datanode____.i12avd/webapp 2023-07-15 22:10:59,843 INFO [Listener at localhost/39415] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36575 2023-07-15 22:10:59,866 WARN [Listener at localhost/35781] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-15 22:10:59,901 WARN [Listener at localhost/35781] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-15 22:10:59,908 WARN [Listener at localhost/35781] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-15 22:10:59,910 INFO [Listener at localhost/35781] log.Slf4jLog(67): jetty-6.1.26 2023-07-15 22:10:59,940 INFO [Listener at localhost/35781] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97e758c6-fe86-0ed9-092f-cd0594d33e04/java.io.tmpdir/Jetty_localhost_36429_datanode____.kkdkgx/webapp 2023-07-15 22:11:00,125 INFO [Listener at localhost/35781] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36429 2023-07-15 22:11:00,155 WARN [Listener at localhost/35789] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-15 22:11:00,304 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x983853b86c8600e7: Processing first storage report for DS-9bb48a38-8fe0-4ce2-8c59-09fb1587f946 from datanode 412c42cc-0c54-4ab6-8f9f-9a3777441320 2023-07-15 22:11:00,306 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x983853b86c8600e7: from storage DS-9bb48a38-8fe0-4ce2-8c59-09fb1587f946 node DatanodeRegistration(127.0.0.1:35699, datanodeUuid=412c42cc-0c54-4ab6-8f9f-9a3777441320, infoPort=37915, infoSecurePort=0, ipcPort=35781, storageInfo=lv=-57;cid=testClusterID;nsid=1554633741;c=1689459057509), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-07-15 22:11:00,306 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x983853b86c8600e7: Processing first storage report for DS-aa593dfc-b9f7-4173-9763-30a5d14046a4 from datanode 412c42cc-0c54-4ab6-8f9f-9a3777441320 2023-07-15 22:11:00,306 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x983853b86c8600e7: from storage DS-aa593dfc-b9f7-4173-9763-30a5d14046a4 node DatanodeRegistration(127.0.0.1:35699, datanodeUuid=412c42cc-0c54-4ab6-8f9f-9a3777441320, infoPort=37915, infoSecurePort=0, ipcPort=35781, storageInfo=lv=-57;cid=testClusterID;nsid=1554633741;c=1689459057509), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-15 22:11:00,315 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x9030251b9c15b074: Processing first storage report for DS-f3d4c9a4-5ba6-4b9f-8f57-6dc2613ecb38 from datanode bfe5f506-d721-4a60-8189-6ea104b7525a 2023-07-15 22:11:00,315 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x9030251b9c15b074: from storage DS-f3d4c9a4-5ba6-4b9f-8f57-6dc2613ecb38 node DatanodeRegistration(127.0.0.1:46813, datanodeUuid=bfe5f506-d721-4a60-8189-6ea104b7525a, infoPort=32937, infoSecurePort=0, ipcPort=39415, storageInfo=lv=-57;cid=testClusterID;nsid=1554633741;c=1689459057509), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-15 22:11:00,315 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x9030251b9c15b074: Processing first storage report for DS-274c7e11-be32-4a90-8d39-08495143cdbd from datanode bfe5f506-d721-4a60-8189-6ea104b7525a 2023-07-15 22:11:00,316 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x9030251b9c15b074: from storage DS-274c7e11-be32-4a90-8d39-08495143cdbd node DatanodeRegistration(127.0.0.1:46813, datanodeUuid=bfe5f506-d721-4a60-8189-6ea104b7525a, infoPort=32937, infoSecurePort=0, ipcPort=39415, storageInfo=lv=-57;cid=testClusterID;nsid=1554633741;c=1689459057509), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-15 22:11:00,382 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc21dd8f2d1affe14: Processing first storage report for DS-bfcd57b3-4026-4d99-9455-f5e0ef0e9fd4 from datanode 397b0bf6-78e5-436e-81cc-6eabfba6ae2a 2023-07-15 22:11:00,382 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc21dd8f2d1affe14: from storage DS-bfcd57b3-4026-4d99-9455-f5e0ef0e9fd4 node DatanodeRegistration(127.0.0.1:33983, datanodeUuid=397b0bf6-78e5-436e-81cc-6eabfba6ae2a, infoPort=40565, infoSecurePort=0, ipcPort=35789, storageInfo=lv=-57;cid=testClusterID;nsid=1554633741;c=1689459057509), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-15 22:11:00,382 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc21dd8f2d1affe14: Processing first storage report for DS-6c45f0df-f8fa-40ca-a65e-e11770e19e93 from datanode 397b0bf6-78e5-436e-81cc-6eabfba6ae2a 2023-07-15 22:11:00,383 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc21dd8f2d1affe14: from storage DS-6c45f0df-f8fa-40ca-a65e-e11770e19e93 node DatanodeRegistration(127.0.0.1:33983, datanodeUuid=397b0bf6-78e5-436e-81cc-6eabfba6ae2a, infoPort=40565, infoSecurePort=0, ipcPort=35789, storageInfo=lv=-57;cid=testClusterID;nsid=1554633741;c=1689459057509), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-15 22:11:00,620 DEBUG [Listener at localhost/35789] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97e758c6-fe86-0ed9-092f-cd0594d33e04 2023-07-15 22:11:00,707 INFO [Listener at localhost/35789] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97e758c6-fe86-0ed9-092f-cd0594d33e04/cluster_fd3e249f-a612-98a2-a131-09cf78600e25/zookeeper_0, clientPort=53678, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97e758c6-fe86-0ed9-092f-cd0594d33e04/cluster_fd3e249f-a612-98a2-a131-09cf78600e25/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97e758c6-fe86-0ed9-092f-cd0594d33e04/cluster_fd3e249f-a612-98a2-a131-09cf78600e25/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-15 22:11:00,727 INFO [Listener at localhost/35789] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=53678 2023-07-15 22:11:00,739 INFO [Listener at localhost/35789] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 22:11:00,742 INFO [Listener at localhost/35789] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 22:11:01,418 INFO [Listener at localhost/35789] util.FSUtils(471): Created version file at hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e with version=8 2023-07-15 22:11:01,419 INFO [Listener at localhost/35789] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/hbase-staging 2023-07-15 22:11:01,797 INFO [Listener at localhost/35789] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-15 22:11:02,456 INFO [Listener at localhost/35789] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-07-15 22:11:02,494 INFO [Listener at localhost/35789] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-15 22:11:02,495 INFO [Listener at localhost/35789] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-15 22:11:02,495 INFO [Listener at localhost/35789] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-15 22:11:02,495 INFO [Listener at localhost/35789] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-15 22:11:02,495 INFO [Listener at localhost/35789] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-15 22:11:02,699 INFO [Listener at localhost/35789] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-15 22:11:02,790 DEBUG [Listener at localhost/35789] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-15 22:11:02,923 INFO [Listener at localhost/35789] ipc.NettyRpcServer(120): Bind to /172.31.14.131:42893 2023-07-15 22:11:02,938 INFO [Listener at localhost/35789] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 22:11:02,941 INFO [Listener at localhost/35789] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 22:11:02,967 INFO [Listener at localhost/35789] zookeeper.RecoverableZooKeeper(93): Process identifier=master:42893 connecting to ZooKeeper ensemble=127.0.0.1:53678 2023-07-15 22:11:03,032 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:428930x0, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-15 22:11:03,043 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:42893-0x1016b09f2d10000 connected 2023-07-15 22:11:03,084 DEBUG [Listener at localhost/35789] zookeeper.ZKUtil(164): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-15 22:11:03,085 DEBUG [Listener at localhost/35789] zookeeper.ZKUtil(164): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-15 22:11:03,104 DEBUG [Listener at localhost/35789] zookeeper.ZKUtil(164): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-15 22:11:03,118 DEBUG [Listener at localhost/35789] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42893 2023-07-15 22:11:03,119 DEBUG [Listener at localhost/35789] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42893 2023-07-15 22:11:03,120 DEBUG [Listener at localhost/35789] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42893 2023-07-15 22:11:03,121 DEBUG [Listener at localhost/35789] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42893 2023-07-15 22:11:03,123 DEBUG [Listener at localhost/35789] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42893 2023-07-15 22:11:03,132 INFO [Listener at localhost/35789] master.HMaster(444): hbase.rootdir=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e, hbase.cluster.distributed=false 2023-07-15 22:11:03,225 INFO [Listener at localhost/35789] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-15 22:11:03,225 INFO [Listener at localhost/35789] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-15 22:11:03,225 INFO [Listener at localhost/35789] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-15 22:11:03,226 INFO [Listener at localhost/35789] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-15 22:11:03,226 INFO [Listener at localhost/35789] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-15 22:11:03,226 INFO [Listener at localhost/35789] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-15 22:11:03,234 INFO [Listener at localhost/35789] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-15 22:11:03,239 INFO [Listener at localhost/35789] ipc.NettyRpcServer(120): Bind to /172.31.14.131:46037 2023-07-15 22:11:03,243 INFO [Listener at localhost/35789] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-15 22:11:03,256 DEBUG [Listener at localhost/35789] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-15 22:11:03,258 INFO [Listener at localhost/35789] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 22:11:03,261 INFO [Listener at localhost/35789] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 22:11:03,263 INFO [Listener at localhost/35789] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:46037 connecting to ZooKeeper ensemble=127.0.0.1:53678 2023-07-15 22:11:03,273 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:460370x0, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-15 22:11:03,275 DEBUG [Listener at localhost/35789] zookeeper.ZKUtil(164): regionserver:460370x0, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-15 22:11:03,280 DEBUG [Listener at localhost/35789] zookeeper.ZKUtil(164): regionserver:460370x0, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-15 22:11:03,281 DEBUG [Listener at localhost/35789] zookeeper.ZKUtil(164): regionserver:460370x0, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-15 22:11:03,285 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:46037-0x1016b09f2d10001 connected 2023-07-15 22:11:03,286 DEBUG [Listener at localhost/35789] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46037 2023-07-15 22:11:03,290 DEBUG [Listener at localhost/35789] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46037 2023-07-15 22:11:03,293 DEBUG [Listener at localhost/35789] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46037 2023-07-15 22:11:03,297 DEBUG [Listener at localhost/35789] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46037 2023-07-15 22:11:03,298 DEBUG [Listener at localhost/35789] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46037 2023-07-15 22:11:03,312 INFO [Listener at localhost/35789] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-15 22:11:03,312 INFO [Listener at localhost/35789] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-15 22:11:03,312 INFO [Listener at localhost/35789] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-15 22:11:03,313 INFO [Listener at localhost/35789] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-15 22:11:03,313 INFO [Listener at localhost/35789] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-15 22:11:03,314 INFO [Listener at localhost/35789] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-15 22:11:03,314 INFO [Listener at localhost/35789] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-15 22:11:03,316 INFO [Listener at localhost/35789] ipc.NettyRpcServer(120): Bind to /172.31.14.131:37287 2023-07-15 22:11:03,317 INFO [Listener at localhost/35789] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-15 22:11:03,321 DEBUG [Listener at localhost/35789] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-15 22:11:03,322 INFO [Listener at localhost/35789] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 22:11:03,324 INFO [Listener at localhost/35789] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 22:11:03,327 INFO [Listener at localhost/35789] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:37287 connecting to ZooKeeper ensemble=127.0.0.1:53678 2023-07-15 22:11:03,341 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:372870x0, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-15 22:11:03,342 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:37287-0x1016b09f2d10002 connected 2023-07-15 22:11:03,343 DEBUG [Listener at localhost/35789] zookeeper.ZKUtil(164): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-15 22:11:03,344 DEBUG [Listener at localhost/35789] zookeeper.ZKUtil(164): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-15 22:11:03,345 DEBUG [Listener at localhost/35789] zookeeper.ZKUtil(164): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-15 22:11:03,348 DEBUG [Listener at localhost/35789] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37287 2023-07-15 22:11:03,350 DEBUG [Listener at localhost/35789] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37287 2023-07-15 22:11:03,351 DEBUG [Listener at localhost/35789] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37287 2023-07-15 22:11:03,352 DEBUG [Listener at localhost/35789] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37287 2023-07-15 22:11:03,354 DEBUG [Listener at localhost/35789] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37287 2023-07-15 22:11:03,371 INFO [Listener at localhost/35789] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-15 22:11:03,371 INFO [Listener at localhost/35789] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-15 22:11:03,371 INFO [Listener at localhost/35789] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-15 22:11:03,372 INFO [Listener at localhost/35789] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-15 22:11:03,372 INFO [Listener at localhost/35789] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-15 22:11:03,372 INFO [Listener at localhost/35789] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-15 22:11:03,372 INFO [Listener at localhost/35789] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-15 22:11:03,374 INFO [Listener at localhost/35789] ipc.NettyRpcServer(120): Bind to /172.31.14.131:38193 2023-07-15 22:11:03,374 INFO [Listener at localhost/35789] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-15 22:11:03,377 DEBUG [Listener at localhost/35789] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-15 22:11:03,379 INFO [Listener at localhost/35789] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 22:11:03,382 INFO [Listener at localhost/35789] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 22:11:03,384 INFO [Listener at localhost/35789] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:38193 connecting to ZooKeeper ensemble=127.0.0.1:53678 2023-07-15 22:11:03,388 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:381930x0, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-15 22:11:03,389 DEBUG [Listener at localhost/35789] zookeeper.ZKUtil(164): regionserver:381930x0, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-15 22:11:03,389 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:38193-0x1016b09f2d10003 connected 2023-07-15 22:11:03,390 DEBUG [Listener at localhost/35789] zookeeper.ZKUtil(164): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-15 22:11:03,391 DEBUG [Listener at localhost/35789] zookeeper.ZKUtil(164): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-15 22:11:03,395 DEBUG [Listener at localhost/35789] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38193 2023-07-15 22:11:03,395 DEBUG [Listener at localhost/35789] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38193 2023-07-15 22:11:03,395 DEBUG [Listener at localhost/35789] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38193 2023-07-15 22:11:03,399 DEBUG [Listener at localhost/35789] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38193 2023-07-15 22:11:03,402 DEBUG [Listener at localhost/35789] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38193 2023-07-15 22:11:03,404 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,42893,1689459061608 2023-07-15 22:11:03,415 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-15 22:11:03,416 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,42893,1689459061608 2023-07-15 22:11:03,438 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-15 22:11:03,438 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-15 22:11:03,438 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-15 22:11:03,438 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 22:11:03,439 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-15 22:11:03,440 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-15 22:11:03,442 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-15 22:11:03,442 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,42893,1689459061608 from backup master directory 2023-07-15 22:11:03,447 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,42893,1689459061608 2023-07-15 22:11:03,447 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-15 22:11:03,448 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-15 22:11:03,448 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,42893,1689459061608 2023-07-15 22:11:03,452 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-15 22:11:03,453 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-15 22:11:03,575 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/hbase.id with ID: 209dff70-c3f7-497c-aa8d-7fb93f1549d6 2023-07-15 22:11:03,618 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 22:11:03,635 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 22:11:03,715 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x515338a4 to 127.0.0.1:53678 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 22:11:03,765 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@63e8b56a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 22:11:03,798 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-15 22:11:03,801 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-15 22:11:03,826 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-15 22:11:03,827 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-15 22:11:03,829 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-15 22:11:03,835 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-15 22:11:03,836 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-15 22:11:03,890 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/MasterData/data/master/store-tmp 2023-07-15 22:11:03,987 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 22:11:03,987 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-15 22:11:03,987 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-15 22:11:03,987 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-15 22:11:03,987 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-15 22:11:03,987 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-15 22:11:03,988 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-15 22:11:03,988 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-15 22:11:03,990 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/MasterData/WALs/jenkins-hbase4.apache.org,42893,1689459061608 2023-07-15 22:11:04,018 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42893%2C1689459061608, suffix=, logDir=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/MasterData/WALs/jenkins-hbase4.apache.org,42893,1689459061608, archiveDir=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/MasterData/oldWALs, maxLogs=10 2023-07-15 22:11:04,121 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33983,DS-bfcd57b3-4026-4d99-9455-f5e0ef0e9fd4,DISK] 2023-07-15 22:11:04,121 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46813,DS-f3d4c9a4-5ba6-4b9f-8f57-6dc2613ecb38,DISK] 2023-07-15 22:11:04,122 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35699,DS-9bb48a38-8fe0-4ce2-8c59-09fb1587f946,DISK] 2023-07-15 22:11:04,130 DEBUG [RS-EventLoopGroup-5-1] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-15 22:11:04,208 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/MasterData/WALs/jenkins-hbase4.apache.org,42893,1689459061608/jenkins-hbase4.apache.org%2C42893%2C1689459061608.1689459064031 2023-07-15 22:11:04,209 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46813,DS-f3d4c9a4-5ba6-4b9f-8f57-6dc2613ecb38,DISK], DatanodeInfoWithStorage[127.0.0.1:35699,DS-9bb48a38-8fe0-4ce2-8c59-09fb1587f946,DISK], DatanodeInfoWithStorage[127.0.0.1:33983,DS-bfcd57b3-4026-4d99-9455-f5e0ef0e9fd4,DISK]] 2023-07-15 22:11:04,209 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-15 22:11:04,210 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 22:11:04,213 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-15 22:11:04,214 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-15 22:11:04,282 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-15 22:11:04,290 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-15 22:11:04,330 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-15 22:11:04,347 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 22:11:04,355 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-15 22:11:04,358 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-15 22:11:04,379 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-15 22:11:04,384 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 22:11:04,385 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71634371, jitterRate=0.06743530929088593}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 22:11:04,385 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-15 22:11:04,391 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-15 22:11:04,417 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-15 22:11:04,418 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-15 22:11:04,421 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-15 22:11:04,424 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 2 msec 2023-07-15 22:11:04,467 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 42 msec 2023-07-15 22:11:04,468 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-15 22:11:04,500 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-15 22:11:04,507 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-15 22:11:04,534 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-15 22:11:04,539 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-15 22:11:04,541 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-15 22:11:04,548 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-15 22:11:04,554 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-15 22:11:04,557 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 22:11:04,561 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-15 22:11:04,562 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-15 22:11:04,582 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-15 22:11:04,591 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-15 22:11:04,591 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-15 22:11:04,591 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-15 22:11:04,591 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-15 22:11:04,591 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 22:11:04,594 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,42893,1689459061608, sessionid=0x1016b09f2d10000, setting cluster-up flag (Was=false) 2023-07-15 22:11:04,617 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 22:11:04,626 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-15 22:11:04,628 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,42893,1689459061608 2023-07-15 22:11:04,636 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 22:11:04,649 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-15 22:11:04,652 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,42893,1689459061608 2023-07-15 22:11:04,655 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.hbase-snapshot/.tmp 2023-07-15 22:11:04,718 INFO [RS:2;jenkins-hbase4:38193] regionserver.HRegionServer(951): ClusterId : 209dff70-c3f7-497c-aa8d-7fb93f1549d6 2023-07-15 22:11:04,718 INFO [RS:0;jenkins-hbase4:46037] regionserver.HRegionServer(951): ClusterId : 209dff70-c3f7-497c-aa8d-7fb93f1549d6 2023-07-15 22:11:04,731 INFO [RS:1;jenkins-hbase4:37287] regionserver.HRegionServer(951): ClusterId : 209dff70-c3f7-497c-aa8d-7fb93f1549d6 2023-07-15 22:11:04,731 DEBUG [RS:0;jenkins-hbase4:46037] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-15 22:11:04,731 DEBUG [RS:2;jenkins-hbase4:38193] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-15 22:11:04,732 DEBUG [RS:1;jenkins-hbase4:37287] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-15 22:11:04,740 DEBUG [RS:1;jenkins-hbase4:37287] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-15 22:11:04,740 DEBUG [RS:1;jenkins-hbase4:37287] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-15 22:11:04,740 DEBUG [RS:2;jenkins-hbase4:38193] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-15 22:11:04,740 DEBUG [RS:2;jenkins-hbase4:38193] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-15 22:11:04,740 DEBUG [RS:0;jenkins-hbase4:46037] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-15 22:11:04,741 DEBUG [RS:0;jenkins-hbase4:46037] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-15 22:11:04,745 DEBUG [RS:1;jenkins-hbase4:37287] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-15 22:11:04,747 DEBUG [RS:0;jenkins-hbase4:46037] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-15 22:11:04,750 DEBUG [RS:2;jenkins-hbase4:38193] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-15 22:11:04,749 DEBUG [RS:1;jenkins-hbase4:37287] zookeeper.ReadOnlyZKClient(139): Connect 0x3e2a0a7b to 127.0.0.1:53678 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 22:11:04,749 DEBUG [RS:0;jenkins-hbase4:46037] zookeeper.ReadOnlyZKClient(139): Connect 0x7c99c080 to 127.0.0.1:53678 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 22:11:04,764 DEBUG [RS:2;jenkins-hbase4:38193] zookeeper.ReadOnlyZKClient(139): Connect 0x236e8ee8 to 127.0.0.1:53678 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 22:11:04,811 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-15 22:11:04,823 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 22:11:04,823 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-15 22:11:04,824 DEBUG [RS:0;jenkins-hbase4:46037] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@292c6337, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 22:11:04,825 DEBUG [RS:1;jenkins-hbase4:37287] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@32642e6b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 22:11:04,825 DEBUG [RS:0;jenkins-hbase4:46037] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2840486d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-15 22:11:04,825 DEBUG [RS:1;jenkins-hbase4:37287] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@31ad100f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-15 22:11:04,831 DEBUG [RS:2;jenkins-hbase4:38193] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4d5a8e15, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 22:11:04,831 DEBUG [RS:2;jenkins-hbase4:38193] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@c4b342, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-15 22:11:04,857 DEBUG [RS:1;jenkins-hbase4:37287] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:37287 2023-07-15 22:11:04,858 DEBUG [RS:2;jenkins-hbase4:38193] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:38193 2023-07-15 22:11:04,866 INFO [RS:2;jenkins-hbase4:38193] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-15 22:11:04,866 INFO [RS:2;jenkins-hbase4:38193] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-15 22:11:04,866 DEBUG [RS:2;jenkins-hbase4:38193] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-15 22:11:04,867 INFO [RS:1;jenkins-hbase4:37287] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-15 22:11:04,871 INFO [RS:1;jenkins-hbase4:37287] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-15 22:11:04,871 DEBUG [RS:1;jenkins-hbase4:37287] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-15 22:11:04,872 INFO [RS:1;jenkins-hbase4:37287] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 22:11:04,872 DEBUG [RS:1;jenkins-hbase4:37287] regionserver.HRegionServer(1022): About to register with Master. 2023-07-15 22:11:04,872 DEBUG [RS:0;jenkins-hbase4:46037] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:46037 2023-07-15 22:11:04,873 INFO [RS:0;jenkins-hbase4:46037] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-15 22:11:04,873 INFO [RS:0;jenkins-hbase4:46037] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-15 22:11:04,873 DEBUG [RS:0;jenkins-hbase4:46037] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-15 22:11:04,873 INFO [RS:0;jenkins-hbase4:46037] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 22:11:04,873 DEBUG [RS:0;jenkins-hbase4:46037] regionserver.HRegionServer(1022): About to register with Master. 2023-07-15 22:11:04,868 INFO [RS:2;jenkins-hbase4:38193] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 22:11:04,875 DEBUG [RS:2;jenkins-hbase4:38193] regionserver.HRegionServer(1022): About to register with Master. 2023-07-15 22:11:04,875 INFO [RS:1;jenkins-hbase4:37287] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,42893,1689459061608 with isa=jenkins-hbase4.apache.org/172.31.14.131:37287, startcode=1689459063311 2023-07-15 22:11:04,875 INFO [RS:0;jenkins-hbase4:46037] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,42893,1689459061608 with isa=jenkins-hbase4.apache.org/172.31.14.131:46037, startcode=1689459063224 2023-07-15 22:11:04,877 INFO [RS:2;jenkins-hbase4:38193] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,42893,1689459061608 with isa=jenkins-hbase4.apache.org/172.31.14.131:38193, startcode=1689459063370 2023-07-15 22:11:04,900 DEBUG [RS:2;jenkins-hbase4:38193] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-15 22:11:04,900 DEBUG [RS:0;jenkins-hbase4:46037] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-15 22:11:04,903 DEBUG [RS:1;jenkins-hbase4:37287] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-15 22:11:04,933 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-15 22:11:04,951 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-15 22:11:04,952 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-15 22:11:04,952 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-15 22:11:04,952 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-15 22:11:04,952 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-07-15 22:11:04,952 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 22:11:04,952 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-15 22:11:04,952 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 22:11:04,988 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689459094988 2023-07-15 22:11:04,991 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-15 22:11:04,993 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58077, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-15 22:11:05,001 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58715, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-15 22:11:05,002 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60511, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-15 22:11:05,006 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42893] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-15 22:11:05,007 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-15 22:11:05,012 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-15 22:11:05,013 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-15 22:11:05,016 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-15 22:11:05,017 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-15 22:11:05,018 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-15 22:11:05,018 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-15 22:11:05,019 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-15 22:11:05,020 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42893] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-15 22:11:05,020 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-15 22:11:05,021 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42893] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-15 22:11:05,022 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-15 22:11:05,023 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-15 22:11:05,023 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-15 22:11:05,035 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-15 22:11:05,036 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-15 22:11:05,041 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689459065038,5,FailOnTimeoutGroup] 2023-07-15 22:11:05,057 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689459065041,5,FailOnTimeoutGroup] 2023-07-15 22:11:05,057 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-15 22:11:05,057 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-15 22:11:05,059 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-15 22:11:05,060 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-15 22:11:05,071 DEBUG [RS:2;jenkins-hbase4:38193] regionserver.HRegionServer(2830): Master is not running yet 2023-07-15 22:11:05,071 DEBUG [RS:0;jenkins-hbase4:46037] regionserver.HRegionServer(2830): Master is not running yet 2023-07-15 22:11:05,072 WARN [RS:2;jenkins-hbase4:38193] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-15 22:11:05,071 DEBUG [RS:1;jenkins-hbase4:37287] regionserver.HRegionServer(2830): Master is not running yet 2023-07-15 22:11:05,072 WARN [RS:0;jenkins-hbase4:46037] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-15 22:11:05,072 WARN [RS:1;jenkins-hbase4:37287] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-15 22:11:05,122 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-15 22:11:05,124 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-15 22:11:05,124 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e 2023-07-15 22:11:05,191 INFO [RS:1;jenkins-hbase4:37287] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,42893,1689459061608 with isa=jenkins-hbase4.apache.org/172.31.14.131:37287, startcode=1689459063311 2023-07-15 22:11:05,191 INFO [RS:0;jenkins-hbase4:46037] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,42893,1689459061608 with isa=jenkins-hbase4.apache.org/172.31.14.131:46037, startcode=1689459063224 2023-07-15 22:11:05,192 INFO [RS:2;jenkins-hbase4:38193] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,42893,1689459061608 with isa=jenkins-hbase4.apache.org/172.31.14.131:38193, startcode=1689459063370 2023-07-15 22:11:05,201 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42893] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:05,219 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42893] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:11:05,244 DEBUG [RS:1;jenkins-hbase4:37287] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e 2023-07-15 22:11:05,245 DEBUG [RS:1;jenkins-hbase4:37287] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:33847 2023-07-15 22:11:05,245 DEBUG [RS:1;jenkins-hbase4:37287] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-15 22:11:05,245 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42893] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:05,246 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 22:11:05,253 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-15 22:11:05,254 DEBUG [RS:2;jenkins-hbase4:38193] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e 2023-07-15 22:11:05,255 DEBUG [RS:2;jenkins-hbase4:38193] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:33847 2023-07-15 22:11:05,255 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-15 22:11:05,255 DEBUG [RS:0;jenkins-hbase4:46037] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e 2023-07-15 22:11:05,255 DEBUG [RS:2;jenkins-hbase4:38193] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-15 22:11:05,255 DEBUG [RS:0;jenkins-hbase4:46037] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:33847 2023-07-15 22:11:05,255 DEBUG [RS:0;jenkins-hbase4:46037] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-15 22:11:05,255 DEBUG [RS:1;jenkins-hbase4:37287] zookeeper.ZKUtil(162): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:05,256 WARN [RS:1;jenkins-hbase4:37287] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-15 22:11:05,256 INFO [RS:1;jenkins-hbase4:37287] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-15 22:11:05,257 DEBUG [RS:1;jenkins-hbase4:37287] regionserver.HRegionServer(1948): logDir=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/WALs/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:05,267 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/hbase/meta/1588230740/info 2023-07-15 22:11:05,268 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-15 22:11:05,269 DEBUG [RS:2;jenkins-hbase4:38193] zookeeper.ZKUtil(162): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:11:05,269 DEBUG [RS:0;jenkins-hbase4:46037] zookeeper.ZKUtil(162): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:05,270 WARN [RS:0;jenkins-hbase4:46037] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-15 22:11:05,269 WARN [RS:2;jenkins-hbase4:38193] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-15 22:11:05,271 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 22:11:05,271 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-15 22:11:05,270 INFO [RS:0;jenkins-hbase4:46037] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-15 22:11:05,270 INFO [RS:2;jenkins-hbase4:38193] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-15 22:11:05,272 DEBUG [RS:0;jenkins-hbase4:46037] regionserver.HRegionServer(1948): logDir=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/WALs/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:05,272 DEBUG [RS:2;jenkins-hbase4:38193] regionserver.HRegionServer(1948): logDir=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/WALs/jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:11:05,273 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,38193,1689459063370] 2023-07-15 22:11:05,273 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,46037,1689459063224] 2023-07-15 22:11:05,273 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,37287,1689459063311] 2023-07-15 22:11:05,282 DEBUG [RS:1;jenkins-hbase4:37287] zookeeper.ZKUtil(162): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:11:05,284 DEBUG [RS:1;jenkins-hbase4:37287] zookeeper.ZKUtil(162): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:05,285 DEBUG [RS:2;jenkins-hbase4:38193] zookeeper.ZKUtil(162): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:11:05,285 DEBUG [RS:1;jenkins-hbase4:37287] zookeeper.ZKUtil(162): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:05,286 DEBUG [RS:2;jenkins-hbase4:38193] zookeeper.ZKUtil(162): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:05,286 DEBUG [RS:2;jenkins-hbase4:38193] zookeeper.ZKUtil(162): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:05,287 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/hbase/meta/1588230740/rep_barrier 2023-07-15 22:11:05,288 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-15 22:11:05,288 DEBUG [RS:0;jenkins-hbase4:46037] zookeeper.ZKUtil(162): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:11:05,289 DEBUG [RS:0;jenkins-hbase4:46037] zookeeper.ZKUtil(162): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:05,289 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 22:11:05,290 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-15 22:11:05,290 DEBUG [RS:0;jenkins-hbase4:46037] zookeeper.ZKUtil(162): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:05,294 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/hbase/meta/1588230740/table 2023-07-15 22:11:05,294 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-15 22:11:05,296 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 22:11:05,297 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/hbase/meta/1588230740 2023-07-15 22:11:05,303 DEBUG [RS:0;jenkins-hbase4:46037] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-15 22:11:05,303 DEBUG [RS:2;jenkins-hbase4:38193] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-15 22:11:05,312 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/hbase/meta/1588230740 2023-07-15 22:11:05,303 DEBUG [RS:1;jenkins-hbase4:37287] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-15 22:11:05,318 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-15 22:11:05,325 INFO [RS:0;jenkins-hbase4:46037] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-15 22:11:05,328 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-15 22:11:05,335 INFO [RS:1;jenkins-hbase4:37287] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-15 22:11:05,335 INFO [RS:2;jenkins-hbase4:38193] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-15 22:11:05,357 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 22:11:05,359 INFO [RS:0;jenkins-hbase4:46037] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-15 22:11:05,360 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59238809, jitterRate=-0.11727295815944672}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-15 22:11:05,360 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-15 22:11:05,360 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-15 22:11:05,360 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-15 22:11:05,360 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-15 22:11:05,360 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-15 22:11:05,360 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-15 22:11:05,364 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-15 22:11:05,364 INFO [RS:1;jenkins-hbase4:37287] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-15 22:11:05,370 INFO [RS:0;jenkins-hbase4:46037] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-15 22:11:05,370 INFO [RS:0;jenkins-hbase4:46037] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-15 22:11:05,370 INFO [RS:2;jenkins-hbase4:38193] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-15 22:11:05,370 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-15 22:11:05,370 INFO [RS:1;jenkins-hbase4:37287] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-15 22:11:05,375 INFO [RS:2;jenkins-hbase4:38193] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-15 22:11:05,375 INFO [RS:0;jenkins-hbase4:46037] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-15 22:11:05,379 INFO [RS:2;jenkins-hbase4:38193] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-15 22:11:05,376 INFO [RS:1;jenkins-hbase4:37287] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-15 22:11:05,383 INFO [RS:2;jenkins-hbase4:38193] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-15 22:11:05,384 INFO [RS:1;jenkins-hbase4:37287] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-15 22:11:05,391 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-15 22:11:05,391 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-15 22:11:05,396 INFO [RS:0;jenkins-hbase4:46037] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-15 22:11:05,396 INFO [RS:1;jenkins-hbase4:37287] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-15 22:11:05,397 DEBUG [RS:1;jenkins-hbase4:37287] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 22:11:05,397 DEBUG [RS:1;jenkins-hbase4:37287] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 22:11:05,398 DEBUG [RS:1;jenkins-hbase4:37287] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 22:11:05,398 INFO [RS:2;jenkins-hbase4:38193] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-15 22:11:05,398 DEBUG [RS:1;jenkins-hbase4:37287] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 22:11:05,398 DEBUG [RS:0;jenkins-hbase4:46037] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 22:11:05,399 DEBUG [RS:0;jenkins-hbase4:46037] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 22:11:05,399 DEBUG [RS:0;jenkins-hbase4:46037] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 22:11:05,399 DEBUG [RS:0;jenkins-hbase4:46037] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 22:11:05,399 DEBUG [RS:2;jenkins-hbase4:38193] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 22:11:05,399 DEBUG [RS:0;jenkins-hbase4:46037] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 22:11:05,399 DEBUG [RS:2;jenkins-hbase4:38193] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 22:11:05,400 DEBUG [RS:0;jenkins-hbase4:46037] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-15 22:11:05,400 DEBUG [RS:2;jenkins-hbase4:38193] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 22:11:05,400 DEBUG [RS:0;jenkins-hbase4:46037] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 22:11:05,400 DEBUG [RS:2;jenkins-hbase4:38193] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 22:11:05,399 DEBUG [RS:1;jenkins-hbase4:37287] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 22:11:05,400 DEBUG [RS:2;jenkins-hbase4:38193] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 22:11:05,400 DEBUG [RS:0;jenkins-hbase4:46037] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 22:11:05,400 DEBUG [RS:2;jenkins-hbase4:38193] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-15 22:11:05,400 DEBUG [RS:0;jenkins-hbase4:46037] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 22:11:05,400 DEBUG [RS:2;jenkins-hbase4:38193] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 22:11:05,400 DEBUG [RS:0;jenkins-hbase4:46037] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 22:11:05,400 DEBUG [RS:2;jenkins-hbase4:38193] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 22:11:05,400 DEBUG [RS:1;jenkins-hbase4:37287] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-15 22:11:05,401 DEBUG [RS:2;jenkins-hbase4:38193] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 22:11:05,401 DEBUG [RS:1;jenkins-hbase4:37287] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 22:11:05,401 DEBUG [RS:2;jenkins-hbase4:38193] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 22:11:05,401 DEBUG [RS:1;jenkins-hbase4:37287] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 22:11:05,401 DEBUG [RS:1;jenkins-hbase4:37287] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 22:11:05,401 DEBUG [RS:1;jenkins-hbase4:37287] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 22:11:05,407 INFO [RS:1;jenkins-hbase4:37287] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-15 22:11:05,408 INFO [RS:1;jenkins-hbase4:37287] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-15 22:11:05,408 INFO [RS:1;jenkins-hbase4:37287] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-15 22:11:05,408 INFO [RS:2;jenkins-hbase4:38193] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-15 22:11:05,408 INFO [RS:2;jenkins-hbase4:38193] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-15 22:11:05,408 INFO [RS:2;jenkins-hbase4:38193] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-15 22:11:05,413 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-15 22:11:05,431 INFO [RS:1;jenkins-hbase4:37287] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-15 22:11:05,431 INFO [RS:2;jenkins-hbase4:38193] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-15 22:11:05,431 INFO [RS:0;jenkins-hbase4:46037] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-15 22:11:05,432 INFO [RS:0;jenkins-hbase4:46037] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-15 22:11:05,432 INFO [RS:0;jenkins-hbase4:46037] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-15 22:11:05,435 INFO [RS:1;jenkins-hbase4:37287] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37287,1689459063311-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-15 22:11:05,435 INFO [RS:2;jenkins-hbase4:38193] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38193,1689459063370-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-15 22:11:05,446 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-15 22:11:05,450 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-15 22:11:05,460 INFO [RS:1;jenkins-hbase4:37287] regionserver.Replication(203): jenkins-hbase4.apache.org,37287,1689459063311 started 2023-07-15 22:11:05,460 INFO [RS:1;jenkins-hbase4:37287] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,37287,1689459063311, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:37287, sessionid=0x1016b09f2d10002 2023-07-15 22:11:05,461 DEBUG [RS:1;jenkins-hbase4:37287] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-15 22:11:05,461 DEBUG [RS:1;jenkins-hbase4:37287] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:05,461 DEBUG [RS:1;jenkins-hbase4:37287] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37287,1689459063311' 2023-07-15 22:11:05,461 DEBUG [RS:1;jenkins-hbase4:37287] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-15 22:11:05,461 DEBUG [RS:1;jenkins-hbase4:37287] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-15 22:11:05,462 DEBUG [RS:1;jenkins-hbase4:37287] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-15 22:11:05,462 DEBUG [RS:1;jenkins-hbase4:37287] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-15 22:11:05,462 DEBUG [RS:1;jenkins-hbase4:37287] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:05,462 DEBUG [RS:1;jenkins-hbase4:37287] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37287,1689459063311' 2023-07-15 22:11:05,462 DEBUG [RS:1;jenkins-hbase4:37287] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:11:05,464 DEBUG [RS:1;jenkins-hbase4:37287] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:11:05,465 DEBUG [RS:1;jenkins-hbase4:37287] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-15 22:11:05,465 INFO [RS:1;jenkins-hbase4:37287] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-15 22:11:05,465 INFO [RS:1;jenkins-hbase4:37287] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-15 22:11:05,469 INFO [RS:0;jenkins-hbase4:46037] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-15 22:11:05,469 INFO [RS:0;jenkins-hbase4:46037] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46037,1689459063224-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-15 22:11:05,470 INFO [RS:2;jenkins-hbase4:38193] regionserver.Replication(203): jenkins-hbase4.apache.org,38193,1689459063370 started 2023-07-15 22:11:05,470 INFO [RS:2;jenkins-hbase4:38193] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,38193,1689459063370, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:38193, sessionid=0x1016b09f2d10003 2023-07-15 22:11:05,470 DEBUG [RS:2;jenkins-hbase4:38193] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-15 22:11:05,470 DEBUG [RS:2;jenkins-hbase4:38193] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:11:05,480 DEBUG [RS:2;jenkins-hbase4:38193] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38193,1689459063370' 2023-07-15 22:11:05,481 DEBUG [RS:2;jenkins-hbase4:38193] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-15 22:11:05,482 DEBUG [RS:2;jenkins-hbase4:38193] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-15 22:11:05,483 DEBUG [RS:2;jenkins-hbase4:38193] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-15 22:11:05,483 DEBUG [RS:2;jenkins-hbase4:38193] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-15 22:11:05,483 DEBUG [RS:2;jenkins-hbase4:38193] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:11:05,484 DEBUG [RS:2;jenkins-hbase4:38193] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38193,1689459063370' 2023-07-15 22:11:05,484 DEBUG [RS:2;jenkins-hbase4:38193] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:11:05,485 DEBUG [RS:2;jenkins-hbase4:38193] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:11:05,485 DEBUG [RS:2;jenkins-hbase4:38193] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-15 22:11:05,485 INFO [RS:2;jenkins-hbase4:38193] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-15 22:11:05,486 INFO [RS:2;jenkins-hbase4:38193] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-15 22:11:05,491 INFO [RS:0;jenkins-hbase4:46037] regionserver.Replication(203): jenkins-hbase4.apache.org,46037,1689459063224 started 2023-07-15 22:11:05,491 INFO [RS:0;jenkins-hbase4:46037] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,46037,1689459063224, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:46037, sessionid=0x1016b09f2d10001 2023-07-15 22:11:05,491 DEBUG [RS:0;jenkins-hbase4:46037] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-15 22:11:05,491 DEBUG [RS:0;jenkins-hbase4:46037] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:05,491 DEBUG [RS:0;jenkins-hbase4:46037] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46037,1689459063224' 2023-07-15 22:11:05,492 DEBUG [RS:0;jenkins-hbase4:46037] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-15 22:11:05,492 DEBUG [RS:0;jenkins-hbase4:46037] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-15 22:11:05,493 DEBUG [RS:0;jenkins-hbase4:46037] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-15 22:11:05,493 DEBUG [RS:0;jenkins-hbase4:46037] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-15 22:11:05,493 DEBUG [RS:0;jenkins-hbase4:46037] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:05,493 DEBUG [RS:0;jenkins-hbase4:46037] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46037,1689459063224' 2023-07-15 22:11:05,493 DEBUG [RS:0;jenkins-hbase4:46037] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:11:05,494 DEBUG [RS:0;jenkins-hbase4:46037] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:11:05,494 DEBUG [RS:0;jenkins-hbase4:46037] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-15 22:11:05,494 INFO [RS:0;jenkins-hbase4:46037] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-15 22:11:05,494 INFO [RS:0;jenkins-hbase4:46037] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-15 22:11:05,580 INFO [RS:1;jenkins-hbase4:37287] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37287%2C1689459063311, suffix=, logDir=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/WALs/jenkins-hbase4.apache.org,37287,1689459063311, archiveDir=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/oldWALs, maxLogs=32 2023-07-15 22:11:05,596 INFO [RS:2;jenkins-hbase4:38193] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38193%2C1689459063370, suffix=, logDir=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/WALs/jenkins-hbase4.apache.org,38193,1689459063370, archiveDir=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/oldWALs, maxLogs=32 2023-07-15 22:11:05,598 INFO [RS:0;jenkins-hbase4:46037] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46037%2C1689459063224, suffix=, logDir=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/WALs/jenkins-hbase4.apache.org,46037,1689459063224, archiveDir=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/oldWALs, maxLogs=32 2023-07-15 22:11:05,602 DEBUG [jenkins-hbase4:42893] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-15 22:11:05,608 DEBUG [jenkins-hbase4:42893] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-15 22:11:05,640 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46813,DS-f3d4c9a4-5ba6-4b9f-8f57-6dc2613ecb38,DISK] 2023-07-15 22:11:05,641 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33983,DS-bfcd57b3-4026-4d99-9455-f5e0ef0e9fd4,DISK] 2023-07-15 22:11:05,644 DEBUG [jenkins-hbase4:42893] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-15 22:11:05,644 DEBUG [jenkins-hbase4:42893] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-15 22:11:05,644 DEBUG [jenkins-hbase4:42893] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-15 22:11:05,644 DEBUG [jenkins-hbase4:42893] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-15 22:11:05,661 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,38193,1689459063370, state=OPENING 2023-07-15 22:11:05,663 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33983,DS-bfcd57b3-4026-4d99-9455-f5e0ef0e9fd4,DISK] 2023-07-15 22:11:05,670 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35699,DS-9bb48a38-8fe0-4ce2-8c59-09fb1587f946,DISK] 2023-07-15 22:11:05,672 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46813,DS-f3d4c9a4-5ba6-4b9f-8f57-6dc2613ecb38,DISK] 2023-07-15 22:11:05,672 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35699,DS-9bb48a38-8fe0-4ce2-8c59-09fb1587f946,DISK] 2023-07-15 22:11:05,688 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-15 22:11:05,690 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 22:11:05,691 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-15 22:11:05,698 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,38193,1689459063370}] 2023-07-15 22:11:05,706 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33983,DS-bfcd57b3-4026-4d99-9455-f5e0ef0e9fd4,DISK] 2023-07-15 22:11:05,707 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35699,DS-9bb48a38-8fe0-4ce2-8c59-09fb1587f946,DISK] 2023-07-15 22:11:05,707 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46813,DS-f3d4c9a4-5ba6-4b9f-8f57-6dc2613ecb38,DISK] 2023-07-15 22:11:05,719 INFO [RS:0;jenkins-hbase4:46037] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/WALs/jenkins-hbase4.apache.org,46037,1689459063224/jenkins-hbase4.apache.org%2C46037%2C1689459063224.1689459065600 2023-07-15 22:11:05,720 INFO [RS:1;jenkins-hbase4:37287] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/WALs/jenkins-hbase4.apache.org,37287,1689459063311/jenkins-hbase4.apache.org%2C37287%2C1689459063311.1689459065583 2023-07-15 22:11:05,729 DEBUG [RS:1;jenkins-hbase4:37287] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46813,DS-f3d4c9a4-5ba6-4b9f-8f57-6dc2613ecb38,DISK], DatanodeInfoWithStorage[127.0.0.1:35699,DS-9bb48a38-8fe0-4ce2-8c59-09fb1587f946,DISK], DatanodeInfoWithStorage[127.0.0.1:33983,DS-bfcd57b3-4026-4d99-9455-f5e0ef0e9fd4,DISK]] 2023-07-15 22:11:05,743 DEBUG [RS:0;jenkins-hbase4:46037] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46813,DS-f3d4c9a4-5ba6-4b9f-8f57-6dc2613ecb38,DISK], DatanodeInfoWithStorage[127.0.0.1:33983,DS-bfcd57b3-4026-4d99-9455-f5e0ef0e9fd4,DISK], DatanodeInfoWithStorage[127.0.0.1:35699,DS-9bb48a38-8fe0-4ce2-8c59-09fb1587f946,DISK]] 2023-07-15 22:11:05,759 INFO [RS:2;jenkins-hbase4:38193] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/WALs/jenkins-hbase4.apache.org,38193,1689459063370/jenkins-hbase4.apache.org%2C38193%2C1689459063370.1689459065599 2023-07-15 22:11:05,764 DEBUG [RS:2;jenkins-hbase4:38193] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33983,DS-bfcd57b3-4026-4d99-9455-f5e0ef0e9fd4,DISK], DatanodeInfoWithStorage[127.0.0.1:46813,DS-f3d4c9a4-5ba6-4b9f-8f57-6dc2613ecb38,DISK], DatanodeInfoWithStorage[127.0.0.1:35699,DS-9bb48a38-8fe0-4ce2-8c59-09fb1587f946,DISK]] 2023-07-15 22:11:05,909 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:11:05,911 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-15 22:11:05,915 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48234, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-15 22:11:05,929 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-15 22:11:05,930 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-15 22:11:05,934 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38193%2C1689459063370.meta, suffix=.meta, logDir=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/WALs/jenkins-hbase4.apache.org,38193,1689459063370, archiveDir=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/oldWALs, maxLogs=32 2023-07-15 22:11:05,963 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35699,DS-9bb48a38-8fe0-4ce2-8c59-09fb1587f946,DISK] 2023-07-15 22:11:05,966 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46813,DS-f3d4c9a4-5ba6-4b9f-8f57-6dc2613ecb38,DISK] 2023-07-15 22:11:05,969 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33983,DS-bfcd57b3-4026-4d99-9455-f5e0ef0e9fd4,DISK] 2023-07-15 22:11:05,983 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/WALs/jenkins-hbase4.apache.org,38193,1689459063370/jenkins-hbase4.apache.org%2C38193%2C1689459063370.meta.1689459065935.meta 2023-07-15 22:11:05,986 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35699,DS-9bb48a38-8fe0-4ce2-8c59-09fb1587f946,DISK], DatanodeInfoWithStorage[127.0.0.1:46813,DS-f3d4c9a4-5ba6-4b9f-8f57-6dc2613ecb38,DISK], DatanodeInfoWithStorage[127.0.0.1:33983,DS-bfcd57b3-4026-4d99-9455-f5e0ef0e9fd4,DISK]] 2023-07-15 22:11:05,987 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-15 22:11:05,988 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-15 22:11:05,990 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 22:11:05,991 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-15 22:11:05,994 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-15 22:11:05,995 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-15 22:11:06,010 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-15 22:11:06,010 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 22:11:06,010 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-15 22:11:06,010 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-15 22:11:06,013 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-15 22:11:06,016 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/hbase/meta/1588230740/info 2023-07-15 22:11:06,016 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/hbase/meta/1588230740/info 2023-07-15 22:11:06,017 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-15 22:11:06,020 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 22:11:06,020 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-15 22:11:06,022 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/hbase/meta/1588230740/rep_barrier 2023-07-15 22:11:06,022 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/hbase/meta/1588230740/rep_barrier 2023-07-15 22:11:06,023 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-15 22:11:06,025 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 22:11:06,025 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-15 22:11:06,027 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/hbase/meta/1588230740/table 2023-07-15 22:11:06,027 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/hbase/meta/1588230740/table 2023-07-15 22:11:06,027 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-15 22:11:06,028 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 22:11:06,032 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/hbase/meta/1588230740 2023-07-15 22:11:06,036 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/hbase/meta/1588230740 2023-07-15 22:11:06,042 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-15 22:11:06,044 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-15 22:11:06,046 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64730804, jitterRate=-0.03543585538864136}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-15 22:11:06,050 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-15 22:11:06,074 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689459065901 2023-07-15 22:11:06,109 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-15 22:11:06,110 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-15 22:11:06,115 INFO [PEWorker-2] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,38193,1689459063370, state=OPEN 2023-07-15 22:11:06,118 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-15 22:11:06,118 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-15 22:11:06,126 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-15 22:11:06,126 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,38193,1689459063370 in 420 msec 2023-07-15 22:11:06,133 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-15 22:11:06,133 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 716 msec 2023-07-15 22:11:06,139 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.3040 sec 2023-07-15 22:11:06,139 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689459066139, completionTime=-1 2023-07-15 22:11:06,139 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-15 22:11:06,139 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-15 22:11:06,229 DEBUG [hconnection-0x57410306-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 22:11:06,234 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48250, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 22:11:06,265 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-15 22:11:06,265 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689459126265 2023-07-15 22:11:06,265 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689459186265 2023-07-15 22:11:06,265 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 125 msec 2023-07-15 22:11:06,294 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42893,1689459061608-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-15 22:11:06,294 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42893,1689459061608-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-15 22:11:06,294 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42893,1689459061608-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-15 22:11:06,298 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:42893, period=300000, unit=MILLISECONDS is enabled. 2023-07-15 22:11:06,299 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-15 22:11:06,306 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-15 22:11:06,319 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-15 22:11:06,321 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-15 22:11:06,332 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-15 22:11:06,335 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-15 22:11:06,338 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-15 22:11:06,360 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/hbase/namespace/193c8a58fbee6a39e80e28b4f899ac4c 2023-07-15 22:11:06,362 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/hbase/namespace/193c8a58fbee6a39e80e28b4f899ac4c empty. 2023-07-15 22:11:06,363 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/hbase/namespace/193c8a58fbee6a39e80e28b4f899ac4c 2023-07-15 22:11:06,363 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-15 22:11:06,404 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-15 22:11:06,407 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 193c8a58fbee6a39e80e28b4f899ac4c, NAME => 'hbase:namespace,,1689459066320.193c8a58fbee6a39e80e28b4f899ac4c.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp 2023-07-15 22:11:06,427 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689459066320.193c8a58fbee6a39e80e28b4f899ac4c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 22:11:06,428 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 193c8a58fbee6a39e80e28b4f899ac4c, disabling compactions & flushes 2023-07-15 22:11:06,428 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689459066320.193c8a58fbee6a39e80e28b4f899ac4c. 2023-07-15 22:11:06,428 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689459066320.193c8a58fbee6a39e80e28b4f899ac4c. 2023-07-15 22:11:06,428 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689459066320.193c8a58fbee6a39e80e28b4f899ac4c. after waiting 0 ms 2023-07-15 22:11:06,428 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689459066320.193c8a58fbee6a39e80e28b4f899ac4c. 2023-07-15 22:11:06,428 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689459066320.193c8a58fbee6a39e80e28b4f899ac4c. 2023-07-15 22:11:06,428 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 193c8a58fbee6a39e80e28b4f899ac4c: 2023-07-15 22:11:06,433 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-15 22:11:06,449 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689459066320.193c8a58fbee6a39e80e28b4f899ac4c.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689459066437"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689459066437"}]},"ts":"1689459066437"} 2023-07-15 22:11:06,479 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-15 22:11:06,481 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-15 22:11:06,485 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689459066481"}]},"ts":"1689459066481"} 2023-07-15 22:11:06,490 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-15 22:11:06,493 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-15 22:11:06,495 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-15 22:11:06,495 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-15 22:11:06,495 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-15 22:11:06,495 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-15 22:11:06,497 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=193c8a58fbee6a39e80e28b4f899ac4c, ASSIGN}] 2023-07-15 22:11:06,500 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=193c8a58fbee6a39e80e28b4f899ac4c, ASSIGN 2023-07-15 22:11:06,503 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=193c8a58fbee6a39e80e28b4f899ac4c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38193,1689459063370; forceNewPlan=false, retain=false 2023-07-15 22:11:06,656 INFO [jenkins-hbase4:42893] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-15 22:11:06,657 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=193c8a58fbee6a39e80e28b4f899ac4c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:11:06,658 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689459066320.193c8a58fbee6a39e80e28b4f899ac4c.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689459066657"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689459066657"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689459066657"}]},"ts":"1689459066657"} 2023-07-15 22:11:06,662 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 193c8a58fbee6a39e80e28b4f899ac4c, server=jenkins-hbase4.apache.org,38193,1689459063370}] 2023-07-15 22:11:06,825 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689459066320.193c8a58fbee6a39e80e28b4f899ac4c. 2023-07-15 22:11:06,825 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 193c8a58fbee6a39e80e28b4f899ac4c, NAME => 'hbase:namespace,,1689459066320.193c8a58fbee6a39e80e28b4f899ac4c.', STARTKEY => '', ENDKEY => ''} 2023-07-15 22:11:06,826 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1689459066320.193c8a58fbee6a39e80e28b4f899ac4c. service=AccessControlService 2023-07-15 22:11:06,827 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 22:11:06,828 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 193c8a58fbee6a39e80e28b4f899ac4c 2023-07-15 22:11:06,828 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689459066320.193c8a58fbee6a39e80e28b4f899ac4c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 22:11:06,828 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 193c8a58fbee6a39e80e28b4f899ac4c 2023-07-15 22:11:06,828 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 193c8a58fbee6a39e80e28b4f899ac4c 2023-07-15 22:11:06,831 INFO [StoreOpener-193c8a58fbee6a39e80e28b4f899ac4c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 193c8a58fbee6a39e80e28b4f899ac4c 2023-07-15 22:11:06,834 DEBUG [StoreOpener-193c8a58fbee6a39e80e28b4f899ac4c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/hbase/namespace/193c8a58fbee6a39e80e28b4f899ac4c/info 2023-07-15 22:11:06,834 DEBUG [StoreOpener-193c8a58fbee6a39e80e28b4f899ac4c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/hbase/namespace/193c8a58fbee6a39e80e28b4f899ac4c/info 2023-07-15 22:11:06,834 INFO [StoreOpener-193c8a58fbee6a39e80e28b4f899ac4c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 193c8a58fbee6a39e80e28b4f899ac4c columnFamilyName info 2023-07-15 22:11:06,836 INFO [StoreOpener-193c8a58fbee6a39e80e28b4f899ac4c-1] regionserver.HStore(310): Store=193c8a58fbee6a39e80e28b4f899ac4c/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 22:11:06,837 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/hbase/namespace/193c8a58fbee6a39e80e28b4f899ac4c 2023-07-15 22:11:06,839 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/hbase/namespace/193c8a58fbee6a39e80e28b4f899ac4c 2023-07-15 22:11:06,844 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 193c8a58fbee6a39e80e28b4f899ac4c 2023-07-15 22:11:06,850 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/hbase/namespace/193c8a58fbee6a39e80e28b4f899ac4c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 22:11:06,850 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 193c8a58fbee6a39e80e28b4f899ac4c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71641858, jitterRate=0.06754687428474426}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 22:11:06,851 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 193c8a58fbee6a39e80e28b4f899ac4c: 2023-07-15 22:11:06,853 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689459066320.193c8a58fbee6a39e80e28b4f899ac4c., pid=6, masterSystemTime=1689459066816 2023-07-15 22:11:06,857 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689459066320.193c8a58fbee6a39e80e28b4f899ac4c. 2023-07-15 22:11:06,857 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689459066320.193c8a58fbee6a39e80e28b4f899ac4c. 2023-07-15 22:11:06,859 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=193c8a58fbee6a39e80e28b4f899ac4c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:11:06,860 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689459066320.193c8a58fbee6a39e80e28b4f899ac4c.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689459066858"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689459066858"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689459066858"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689459066858"}]},"ts":"1689459066858"} 2023-07-15 22:11:06,867 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-15 22:11:06,867 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 193c8a58fbee6a39e80e28b4f899ac4c, server=jenkins-hbase4.apache.org,38193,1689459063370 in 201 msec 2023-07-15 22:11:06,871 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-15 22:11:06,872 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=193c8a58fbee6a39e80e28b4f899ac4c, ASSIGN in 370 msec 2023-07-15 22:11:06,873 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-15 22:11:06,873 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689459066873"}]},"ts":"1689459066873"} 2023-07-15 22:11:06,876 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-15 22:11:06,879 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-15 22:11:06,882 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 558 msec 2023-07-15 22:11:06,935 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-15 22:11:06,937 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-15 22:11:06,937 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 22:11:06,980 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-15 22:11:07,001 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-15 22:11:07,010 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 42 msec 2023-07-15 22:11:07,014 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-15 22:11:07,025 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-15 22:11:07,030 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 15 msec 2023-07-15 22:11:07,041 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-15 22:11:07,044 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-15 22:11:07,044 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.596sec 2023-07-15 22:11:07,050 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-15 22:11:07,052 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-15 22:11:07,052 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-15 22:11:07,053 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42893,1689459061608-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-15 22:11:07,054 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42893,1689459061608-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-15 22:11:07,079 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-15 22:11:07,081 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-15 22:11:07,084 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-15 22:11:07,086 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-15 22:11:07,089 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-07-15 22:11:07,097 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/hbase/acl/1a569e443e1a4e5bb2e4d421117ad46c 2023-07-15 22:11:07,097 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-15 22:11:07,099 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/hbase/acl/1a569e443e1a4e5bb2e4d421117ad46c empty. 2023-07-15 22:11:07,101 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/hbase/acl/1a569e443e1a4e5bb2e4d421117ad46c 2023-07-15 22:11:07,101 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-15 22:11:07,129 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-15 22:11:07,130 DEBUG [Listener at localhost/35789] zookeeper.ReadOnlyZKClient(139): Connect 0x1370d70b to 127.0.0.1:53678 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 22:11:07,130 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => 1a569e443e1a4e5bb2e4d421117ad46c, NAME => 'hbase:acl,,1689459067073.1a569e443e1a4e5bb2e4d421117ad46c.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp 2023-07-15 22:11:07,142 DEBUG [Listener at localhost/35789] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6cb4f0a0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 22:11:07,162 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689459067073.1a569e443e1a4e5bb2e4d421117ad46c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 22:11:07,163 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing 1a569e443e1a4e5bb2e4d421117ad46c, disabling compactions & flushes 2023-07-15 22:11:07,163 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689459067073.1a569e443e1a4e5bb2e4d421117ad46c. 2023-07-15 22:11:07,163 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689459067073.1a569e443e1a4e5bb2e4d421117ad46c. 2023-07-15 22:11:07,163 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689459067073.1a569e443e1a4e5bb2e4d421117ad46c. after waiting 0 ms 2023-07-15 22:11:07,164 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689459067073.1a569e443e1a4e5bb2e4d421117ad46c. 2023-07-15 22:11:07,164 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1689459067073.1a569e443e1a4e5bb2e4d421117ad46c. 2023-07-15 22:11:07,164 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for 1a569e443e1a4e5bb2e4d421117ad46c: 2023-07-15 22:11:07,171 DEBUG [hconnection-0x67f0b4bd-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 22:11:07,175 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-15 22:11:07,177 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1689459067073.1a569e443e1a4e5bb2e4d421117ad46c.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689459067176"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689459067176"}]},"ts":"1689459067176"} 2023-07-15 22:11:07,180 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-15 22:11:07,183 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-15 22:11:07,183 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689459067183"}]},"ts":"1689459067183"} 2023-07-15 22:11:07,188 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48266, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 22:11:07,189 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-15 22:11:07,191 INFO [Listener at localhost/35789] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,42893,1689459061608 2023-07-15 22:11:07,191 INFO [Listener at localhost/35789] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-07-15 22:11:07,191 INFO [Listener at localhost/35789] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97e758c6-fe86-0ed9-092f-cd0594d33e04/test.cache.data in system properties and HBase conf 2023-07-15 22:11:07,191 INFO [Listener at localhost/35789] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97e758c6-fe86-0ed9-092f-cd0594d33e04/hadoop.tmp.dir in system properties and HBase conf 2023-07-15 22:11:07,192 INFO [Listener at localhost/35789] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97e758c6-fe86-0ed9-092f-cd0594d33e04/hadoop.log.dir in system properties and HBase conf 2023-07-15 22:11:07,192 INFO [Listener at localhost/35789] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97e758c6-fe86-0ed9-092f-cd0594d33e04/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-15 22:11:07,192 INFO [Listener at localhost/35789] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97e758c6-fe86-0ed9-092f-cd0594d33e04/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-15 22:11:07,192 INFO [Listener at localhost/35789] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-15 22:11:07,192 INFO [Listener at localhost/35789] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97e758c6-fe86-0ed9-092f-cd0594d33e04/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-15 22:11:07,192 INFO [Listener at localhost/35789] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97e758c6-fe86-0ed9-092f-cd0594d33e04/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-15 22:11:07,192 INFO [Listener at localhost/35789] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97e758c6-fe86-0ed9-092f-cd0594d33e04/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-15 22:11:07,192 INFO [Listener at localhost/35789] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97e758c6-fe86-0ed9-092f-cd0594d33e04/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-15 22:11:07,192 INFO [Listener at localhost/35789] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97e758c6-fe86-0ed9-092f-cd0594d33e04/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-15 22:11:07,193 INFO [Listener at localhost/35789] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97e758c6-fe86-0ed9-092f-cd0594d33e04/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-15 22:11:07,193 INFO [Listener at localhost/35789] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97e758c6-fe86-0ed9-092f-cd0594d33e04/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-15 22:11:07,193 INFO [Listener at localhost/35789] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97e758c6-fe86-0ed9-092f-cd0594d33e04/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-15 22:11:07,193 INFO [Listener at localhost/35789] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97e758c6-fe86-0ed9-092f-cd0594d33e04/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-15 22:11:07,193 INFO [Listener at localhost/35789] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97e758c6-fe86-0ed9-092f-cd0594d33e04/nfs.dump.dir in system properties and HBase conf 2023-07-15 22:11:07,194 INFO [Listener at localhost/35789] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97e758c6-fe86-0ed9-092f-cd0594d33e04/java.io.tmpdir in system properties and HBase conf 2023-07-15 22:11:07,194 INFO [Listener at localhost/35789] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97e758c6-fe86-0ed9-092f-cd0594d33e04/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-15 22:11:07,194 INFO [Listener at localhost/35789] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97e758c6-fe86-0ed9-092f-cd0594d33e04/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-15 22:11:07,194 INFO [Listener at localhost/35789] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97e758c6-fe86-0ed9-092f-cd0594d33e04/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-07-15 22:11:07,195 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-15 22:11:07,196 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-15 22:11:07,196 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-15 22:11:07,196 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-15 22:11:07,196 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-15 22:11:07,196 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=1a569e443e1a4e5bb2e4d421117ad46c, ASSIGN}] 2023-07-15 22:11:07,199 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=1a569e443e1a4e5bb2e4d421117ad46c, ASSIGN 2023-07-15 22:11:07,201 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=1a569e443e1a4e5bb2e4d421117ad46c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38193,1689459063370; forceNewPlan=false, retain=false 2023-07-15 22:11:07,203 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-15 22:11:07,351 INFO [jenkins-hbase4:42893] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-15 22:11:07,352 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=1a569e443e1a4e5bb2e4d421117ad46c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:11:07,353 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1689459067073.1a569e443e1a4e5bb2e4d421117ad46c.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689459067352"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689459067352"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689459067352"}]},"ts":"1689459067352"} 2023-07-15 22:11:07,356 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 1a569e443e1a4e5bb2e4d421117ad46c, server=jenkins-hbase4.apache.org,38193,1689459063370}] 2023-07-15 22:11:07,404 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-15 22:11:07,518 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1689459067073.1a569e443e1a4e5bb2e4d421117ad46c. 2023-07-15 22:11:07,518 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1a569e443e1a4e5bb2e4d421117ad46c, NAME => 'hbase:acl,,1689459067073.1a569e443e1a4e5bb2e4d421117ad46c.', STARTKEY => '', ENDKEY => ''} 2023-07-15 22:11:07,518 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1689459067073.1a569e443e1a4e5bb2e4d421117ad46c. service=AccessControlService 2023-07-15 22:11:07,519 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 22:11:07,519 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl 1a569e443e1a4e5bb2e4d421117ad46c 2023-07-15 22:11:07,519 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689459067073.1a569e443e1a4e5bb2e4d421117ad46c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 22:11:07,519 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1a569e443e1a4e5bb2e4d421117ad46c 2023-07-15 22:11:07,519 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1a569e443e1a4e5bb2e4d421117ad46c 2023-07-15 22:11:07,529 INFO [StoreOpener-1a569e443e1a4e5bb2e4d421117ad46c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region 1a569e443e1a4e5bb2e4d421117ad46c 2023-07-15 22:11:07,533 DEBUG [StoreOpener-1a569e443e1a4e5bb2e4d421117ad46c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/hbase/acl/1a569e443e1a4e5bb2e4d421117ad46c/l 2023-07-15 22:11:07,533 DEBUG [StoreOpener-1a569e443e1a4e5bb2e4d421117ad46c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/hbase/acl/1a569e443e1a4e5bb2e4d421117ad46c/l 2023-07-15 22:11:07,533 INFO [StoreOpener-1a569e443e1a4e5bb2e4d421117ad46c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1a569e443e1a4e5bb2e4d421117ad46c columnFamilyName l 2023-07-15 22:11:07,534 INFO [StoreOpener-1a569e443e1a4e5bb2e4d421117ad46c-1] regionserver.HStore(310): Store=1a569e443e1a4e5bb2e4d421117ad46c/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 22:11:07,537 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/hbase/acl/1a569e443e1a4e5bb2e4d421117ad46c 2023-07-15 22:11:07,538 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/hbase/acl/1a569e443e1a4e5bb2e4d421117ad46c 2023-07-15 22:11:07,547 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1a569e443e1a4e5bb2e4d421117ad46c 2023-07-15 22:11:07,551 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/hbase/acl/1a569e443e1a4e5bb2e4d421117ad46c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 22:11:07,553 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1a569e443e1a4e5bb2e4d421117ad46c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67201272, jitterRate=0.0013769865036010742}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 22:11:07,553 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1a569e443e1a4e5bb2e4d421117ad46c: 2023-07-15 22:11:07,555 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1689459067073.1a569e443e1a4e5bb2e4d421117ad46c., pid=11, masterSystemTime=1689459067511 2023-07-15 22:11:07,557 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1689459067073.1a569e443e1a4e5bb2e4d421117ad46c. 2023-07-15 22:11:07,557 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1689459067073.1a569e443e1a4e5bb2e4d421117ad46c. 2023-07-15 22:11:07,559 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=1a569e443e1a4e5bb2e4d421117ad46c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:11:07,559 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1689459067073.1a569e443e1a4e5bb2e4d421117ad46c.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689459067559"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689459067559"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689459067559"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689459067559"}]},"ts":"1689459067559"} 2023-07-15 22:11:07,567 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-15 22:11:07,567 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 1a569e443e1a4e5bb2e4d421117ad46c, server=jenkins-hbase4.apache.org,38193,1689459063370 in 206 msec 2023-07-15 22:11:07,572 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-15 22:11:07,573 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=1a569e443e1a4e5bb2e4d421117ad46c, ASSIGN in 371 msec 2023-07-15 22:11:07,574 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-15 22:11:07,574 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689459067574"}]},"ts":"1689459067574"} 2023-07-15 22:11:07,577 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-15 22:11:07,580 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-15 22:11:07,589 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 502 msec 2023-07-15 22:11:07,704 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-15 22:11:07,705 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-07-15 22:11:07,720 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-15 22:11:08,512 WARN [Thread-382] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-15 22:11:08,794 INFO [Thread-382] log.Slf4jLog(67): jetty-6.1.26 2023-07-15 22:11:08,800 INFO [Thread-382] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97e758c6-fe86-0ed9-092f-cd0594d33e04/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_38911_jobhistory____bbdq65/webapp 2023-07-15 22:11:08,967 INFO [Thread-382] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-07-15 22:11:08,968 INFO [Thread-382] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-07-15 22:11:08,968 INFO [Thread-382] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-15 22:11:08,970 INFO [Thread-382] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-15 22:11:09,042 INFO [Thread-382] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-15 22:11:09,332 INFO [Thread-382] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-15 22:11:09,715 INFO [Thread-382] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-07-15 22:11:09,783 INFO [Thread-382] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:38911 2023-07-15 22:11:10,010 WARN [Listener at jenkins-hbase4.apache.org/34629] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-15 22:11:10,338 WARN [Listener at jenkins-hbase4.apache.org/34629] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-15 22:11:10,338 INFO [Listener at jenkins-hbase4.apache.org/34629] log.Slf4jLog(67): jetty-6.1.26 2023-07-15 22:11:10,344 INFO [Listener at jenkins-hbase4.apache.org/34629] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97e758c6-fe86-0ed9-092f-cd0594d33e04/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_43633_cluster____.gofs37/webapp 2023-07-15 22:11:10,416 INFO [Listener at jenkins-hbase4.apache.org/34629] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-07-15 22:11:10,417 INFO [Listener at jenkins-hbase4.apache.org/34629] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-07-15 22:11:10,417 INFO [Listener at jenkins-hbase4.apache.org/34629] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-15 22:11:10,417 INFO [Listener at jenkins-hbase4.apache.org/34629] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-15 22:11:10,426 INFO [Listener at jenkins-hbase4.apache.org/34629] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-15 22:11:10,616 INFO [Listener at jenkins-hbase4.apache.org/34629] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-15 22:11:10,717 INFO [Listener at jenkins-hbase4.apache.org/34629] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-15 22:11:10,726 INFO [Listener at jenkins-hbase4.apache.org/34629] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:43633 2023-07-15 22:11:11,268 WARN [Listener at jenkins-hbase4.apache.org/36311] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-15 22:11:11,292 WARN [Listener at jenkins-hbase4.apache.org/36311] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-15 22:11:11,293 INFO [Listener at jenkins-hbase4.apache.org/36311] log.Slf4jLog(67): jetty-6.1.26 2023-07-15 22:11:11,300 INFO [Listener at jenkins-hbase4.apache.org/36311] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97e758c6-fe86-0ed9-092f-cd0594d33e04/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_42491_node____f5v70s/webapp 2023-07-15 22:11:11,353 INFO [Listener at jenkins-hbase4.apache.org/36311] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-15 22:11:11,353 INFO [Listener at jenkins-hbase4.apache.org/36311] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-15 22:11:11,354 INFO [Listener at jenkins-hbase4.apache.org/36311] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-15 22:11:11,354 INFO [Listener at jenkins-hbase4.apache.org/36311] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-15 22:11:11,362 INFO [Listener at jenkins-hbase4.apache.org/36311] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-15 22:11:11,384 INFO [Listener at jenkins-hbase4.apache.org/36311] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-15 22:11:11,483 INFO [Listener at jenkins-hbase4.apache.org/36311] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-15 22:11:11,499 INFO [Listener at jenkins-hbase4.apache.org/36311] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:42491 2023-07-15 22:11:11,606 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-15 22:11:11,839 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-15 22:11:11,841 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-15 22:11:11,842 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-15 22:11:11,844 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 22:11:11,844 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-15 22:11:11,845 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 22:11:11,845 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-15 22:11:11,845 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-15 22:11:11,845 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-15 22:11:11,845 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 22:11:11,845 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-15 22:11:11,845 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-15 22:11:11,845 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-15 22:11:11,896 WARN [Listener at jenkins-hbase4.apache.org/46535] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-15 22:11:11,902 WARN [Listener at jenkins-hbase4.apache.org/46535] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-15 22:11:11,903 INFO [Listener at jenkins-hbase4.apache.org/46535] log.Slf4jLog(67): jetty-6.1.26 2023-07-15 22:11:11,909 INFO [Listener at jenkins-hbase4.apache.org/46535] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97e758c6-fe86-0ed9-092f-cd0594d33e04/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_39527_node____.9ashim/webapp 2023-07-15 22:11:11,961 INFO [Listener at jenkins-hbase4.apache.org/46535] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-15 22:11:11,962 INFO [Listener at jenkins-hbase4.apache.org/46535] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-15 22:11:11,962 INFO [Listener at jenkins-hbase4.apache.org/46535] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-15 22:11:11,962 INFO [Listener at jenkins-hbase4.apache.org/46535] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-15 22:11:11,970 INFO [Listener at jenkins-hbase4.apache.org/46535] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-15 22:11:11,987 INFO [Listener at jenkins-hbase4.apache.org/46535] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-15 22:11:12,076 INFO [Listener at jenkins-hbase4.apache.org/46535] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-15 22:11:12,115 INFO [Listener at jenkins-hbase4.apache.org/46535] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:39527 2023-07-15 22:11:12,150 INFO [Listener at jenkins-hbase4.apache.org/46535] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-07-15 22:11:12,152 INFO [Listener at jenkins-hbase4.apache.org/46535] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 22:11:12,221 INFO [Listener at jenkins-hbase4.apache.org/46535] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportWithTargetName Thread=703, OpenFileDescriptor=893, MaxFileDescriptor=60000, SystemLoadAverage=259, ProcessCount=174, AvailableMemoryMB=4914 2023-07-15 22:11:12,221 WARN [Listener at jenkins-hbase4.apache.org/46535] hbase.ResourceChecker(130): Thread=703 is superior to 500 2023-07-15 22:11:12,236 DEBUG [Listener at jenkins-hbase4.apache.org/46535] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-15 22:11:12,249 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48886, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-15 22:11:12,256 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-15 22:11:12,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-07-15 22:11:12,271 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-07-15 22:11:12,272 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-07-15 22:11:12,274 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-15 22:11:12,283 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testExportWithTargetName/5f0f9870744d546ed33237315d62fd5f 2023-07-15 22:11:12,283 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testExportWithTargetName/d8eba43acbd0cee7d3fc2add2d7d9cf3 2023-07-15 22:11:12,288 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testExportWithTargetName/5f0f9870744d546ed33237315d62fd5f empty. 2023-07-15 22:11:12,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-15 22:11:12,288 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testExportWithTargetName/d8eba43acbd0cee7d3fc2add2d7d9cf3 empty. 2023-07-15 22:11:12,289 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testExportWithTargetName/5f0f9870744d546ed33237315d62fd5f 2023-07-15 22:11:12,292 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testExportWithTargetName/d8eba43acbd0cee7d3fc2add2d7d9cf3 2023-07-15 22:11:12,292 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-15 22:11:12,363 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-07-15 22:11:12,367 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => 5f0f9870744d546ed33237315d62fd5f, NAME => 'testtb-testExportWithTargetName,,1689459072256.5f0f9870744d546ed33237315d62fd5f.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp 2023-07-15 22:11:12,371 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => d8eba43acbd0cee7d3fc2add2d7d9cf3, NAME => 'testtb-testExportWithTargetName,1,1689459072256.d8eba43acbd0cee7d3fc2add2d7d9cf3.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp 2023-07-15 22:11:12,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-15 22:11:12,439 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689459072256.d8eba43acbd0cee7d3fc2add2d7d9cf3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 22:11:12,440 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing d8eba43acbd0cee7d3fc2add2d7d9cf3, disabling compactions & flushes 2023-07-15 22:11:12,440 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689459072256.d8eba43acbd0cee7d3fc2add2d7d9cf3. 2023-07-15 22:11:12,440 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689459072256.d8eba43acbd0cee7d3fc2add2d7d9cf3. 2023-07-15 22:11:12,440 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689459072256.d8eba43acbd0cee7d3fc2add2d7d9cf3. after waiting 0 ms 2023-07-15 22:11:12,440 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689459072256.d8eba43acbd0cee7d3fc2add2d7d9cf3. 2023-07-15 22:11:12,441 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689459072256.d8eba43acbd0cee7d3fc2add2d7d9cf3. 2023-07-15 22:11:12,441 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for d8eba43acbd0cee7d3fc2add2d7d9cf3: 2023-07-15 22:11:12,445 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689459072256.5f0f9870744d546ed33237315d62fd5f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 22:11:12,445 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing 5f0f9870744d546ed33237315d62fd5f, disabling compactions & flushes 2023-07-15 22:11:12,445 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689459072256.5f0f9870744d546ed33237315d62fd5f. 2023-07-15 22:11:12,445 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689459072256.5f0f9870744d546ed33237315d62fd5f. 2023-07-15 22:11:12,445 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689459072256.5f0f9870744d546ed33237315d62fd5f. after waiting 0 ms 2023-07-15 22:11:12,445 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689459072256.5f0f9870744d546ed33237315d62fd5f. 2023-07-15 22:11:12,445 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689459072256.5f0f9870744d546ed33237315d62fd5f. 2023-07-15 22:11:12,446 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for 5f0f9870744d546ed33237315d62fd5f: 2023-07-15 22:11:12,454 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-07-15 22:11:12,455 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689459072256.d8eba43acbd0cee7d3fc2add2d7d9cf3.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689459072455"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689459072455"}]},"ts":"1689459072455"} 2023-07-15 22:11:12,456 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689459072256.5f0f9870744d546ed33237315d62fd5f.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689459072455"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689459072455"}]},"ts":"1689459072455"} 2023-07-15 22:11:12,522 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-15 22:11:12,524 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-15 22:11:12,524 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689459072524"}]},"ts":"1689459072524"} 2023-07-15 22:11:12,526 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-07-15 22:11:12,532 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-15 22:11:12,534 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-15 22:11:12,534 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-15 22:11:12,534 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-15 22:11:12,534 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-15 22:11:12,535 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5f0f9870744d546ed33237315d62fd5f, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=d8eba43acbd0cee7d3fc2add2d7d9cf3, ASSIGN}] 2023-07-15 22:11:12,538 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=d8eba43acbd0cee7d3fc2add2d7d9cf3, ASSIGN 2023-07-15 22:11:12,538 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5f0f9870744d546ed33237315d62fd5f, ASSIGN 2023-07-15 22:11:12,539 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=d8eba43acbd0cee7d3fc2add2d7d9cf3, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38193,1689459063370; forceNewPlan=false, retain=false 2023-07-15 22:11:12,539 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5f0f9870744d546ed33237315d62fd5f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46037,1689459063224; forceNewPlan=false, retain=false 2023-07-15 22:11:12,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-15 22:11:12,689 INFO [jenkins-hbase4:42893] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-15 22:11:12,692 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=d8eba43acbd0cee7d3fc2add2d7d9cf3, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:11:12,692 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=5f0f9870744d546ed33237315d62fd5f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:12,693 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689459072256.d8eba43acbd0cee7d3fc2add2d7d9cf3.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689459072692"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689459072692"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689459072692"}]},"ts":"1689459072692"} 2023-07-15 22:11:12,693 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689459072256.5f0f9870744d546ed33237315d62fd5f.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689459072692"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689459072692"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689459072692"}]},"ts":"1689459072692"} 2023-07-15 22:11:12,696 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=13, state=RUNNABLE; OpenRegionProcedure 5f0f9870744d546ed33237315d62fd5f, server=jenkins-hbase4.apache.org,46037,1689459063224}] 2023-07-15 22:11:12,699 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=14, state=RUNNABLE; OpenRegionProcedure d8eba43acbd0cee7d3fc2add2d7d9cf3, server=jenkins-hbase4.apache.org,38193,1689459063370}] 2023-07-15 22:11:12,853 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:12,854 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-15 22:11:12,862 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48212, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-15 22:11:12,879 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1689459072256.d8eba43acbd0cee7d3fc2add2d7d9cf3. 2023-07-15 22:11:12,879 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d8eba43acbd0cee7d3fc2add2d7d9cf3, NAME => 'testtb-testExportWithTargetName,1,1689459072256.d8eba43acbd0cee7d3fc2add2d7d9cf3.', STARTKEY => '1', ENDKEY => ''} 2023-07-15 22:11:12,879 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1689459072256.d8eba43acbd0cee7d3fc2add2d7d9cf3. service=AccessControlService 2023-07-15 22:11:12,880 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 22:11:12,880 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName d8eba43acbd0cee7d3fc2add2d7d9cf3 2023-07-15 22:11:12,880 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689459072256.d8eba43acbd0cee7d3fc2add2d7d9cf3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 22:11:12,880 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d8eba43acbd0cee7d3fc2add2d7d9cf3 2023-07-15 22:11:12,881 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d8eba43acbd0cee7d3fc2add2d7d9cf3 2023-07-15 22:11:12,883 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1689459072256.5f0f9870744d546ed33237315d62fd5f. 2023-07-15 22:11:12,884 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5f0f9870744d546ed33237315d62fd5f, NAME => 'testtb-testExportWithTargetName,,1689459072256.5f0f9870744d546ed33237315d62fd5f.', STARTKEY => '', ENDKEY => '1'} 2023-07-15 22:11:12,884 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1689459072256.5f0f9870744d546ed33237315d62fd5f. service=AccessControlService 2023-07-15 22:11:12,884 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 22:11:12,885 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 5f0f9870744d546ed33237315d62fd5f 2023-07-15 22:11:12,886 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689459072256.5f0f9870744d546ed33237315d62fd5f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 22:11:12,886 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 5f0f9870744d546ed33237315d62fd5f 2023-07-15 22:11:12,886 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 5f0f9870744d546ed33237315d62fd5f 2023-07-15 22:11:12,895 INFO [StoreOpener-5f0f9870744d546ed33237315d62fd5f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 5f0f9870744d546ed33237315d62fd5f 2023-07-15 22:11:12,897 DEBUG [StoreOpener-5f0f9870744d546ed33237315d62fd5f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportWithTargetName/5f0f9870744d546ed33237315d62fd5f/cf 2023-07-15 22:11:12,897 DEBUG [StoreOpener-5f0f9870744d546ed33237315d62fd5f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportWithTargetName/5f0f9870744d546ed33237315d62fd5f/cf 2023-07-15 22:11:12,898 INFO [StoreOpener-5f0f9870744d546ed33237315d62fd5f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5f0f9870744d546ed33237315d62fd5f columnFamilyName cf 2023-07-15 22:11:12,899 INFO [StoreOpener-d8eba43acbd0cee7d3fc2add2d7d9cf3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region d8eba43acbd0cee7d3fc2add2d7d9cf3 2023-07-15 22:11:12,899 INFO [StoreOpener-5f0f9870744d546ed33237315d62fd5f-1] regionserver.HStore(310): Store=5f0f9870744d546ed33237315d62fd5f/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 22:11:12,902 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportWithTargetName/5f0f9870744d546ed33237315d62fd5f 2023-07-15 22:11:12,905 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportWithTargetName/5f0f9870744d546ed33237315d62fd5f 2023-07-15 22:11:12,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-15 22:11:12,912 DEBUG [StoreOpener-d8eba43acbd0cee7d3fc2add2d7d9cf3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportWithTargetName/d8eba43acbd0cee7d3fc2add2d7d9cf3/cf 2023-07-15 22:11:12,912 DEBUG [StoreOpener-d8eba43acbd0cee7d3fc2add2d7d9cf3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportWithTargetName/d8eba43acbd0cee7d3fc2add2d7d9cf3/cf 2023-07-15 22:11:12,913 INFO [StoreOpener-d8eba43acbd0cee7d3fc2add2d7d9cf3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d8eba43acbd0cee7d3fc2add2d7d9cf3 columnFamilyName cf 2023-07-15 22:11:12,914 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 5f0f9870744d546ed33237315d62fd5f 2023-07-15 22:11:12,917 INFO [StoreOpener-d8eba43acbd0cee7d3fc2add2d7d9cf3-1] regionserver.HStore(310): Store=d8eba43acbd0cee7d3fc2add2d7d9cf3/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 22:11:12,934 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportWithTargetName/d8eba43acbd0cee7d3fc2add2d7d9cf3 2023-07-15 22:11:12,934 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportWithTargetName/5f0f9870744d546ed33237315d62fd5f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 22:11:12,935 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportWithTargetName/d8eba43acbd0cee7d3fc2add2d7d9cf3 2023-07-15 22:11:12,935 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 5f0f9870744d546ed33237315d62fd5f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75076778, jitterRate=0.11873117089271545}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 22:11:12,935 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 5f0f9870744d546ed33237315d62fd5f: 2023-07-15 22:11:12,937 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1689459072256.5f0f9870744d546ed33237315d62fd5f., pid=15, masterSystemTime=1689459072853 2023-07-15 22:11:12,954 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d8eba43acbd0cee7d3fc2add2d7d9cf3 2023-07-15 22:11:12,958 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1689459072256.5f0f9870744d546ed33237315d62fd5f. 2023-07-15 22:11:12,959 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=5f0f9870744d546ed33237315d62fd5f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:12,959 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1689459072256.5f0f9870744d546ed33237315d62fd5f.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689459072958"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689459072958"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689459072958"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689459072958"}]},"ts":"1689459072958"} 2023-07-15 22:11:12,967 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=13 2023-07-15 22:11:12,968 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=13, state=SUCCESS; OpenRegionProcedure 5f0f9870744d546ed33237315d62fd5f, server=jenkins-hbase4.apache.org,46037,1689459063224 in 267 msec 2023-07-15 22:11:12,970 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5f0f9870744d546ed33237315d62fd5f, ASSIGN in 432 msec 2023-07-15 22:11:12,975 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1689459072256.5f0f9870744d546ed33237315d62fd5f. 2023-07-15 22:11:12,976 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportWithTargetName/d8eba43acbd0cee7d3fc2add2d7d9cf3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 22:11:12,978 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d8eba43acbd0cee7d3fc2add2d7d9cf3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59141109, jitterRate=-0.11872880160808563}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 22:11:12,978 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d8eba43acbd0cee7d3fc2add2d7d9cf3: 2023-07-15 22:11:12,979 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1689459072256.d8eba43acbd0cee7d3fc2add2d7d9cf3., pid=16, masterSystemTime=1689459072853 2023-07-15 22:11:12,982 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1689459072256.d8eba43acbd0cee7d3fc2add2d7d9cf3. 2023-07-15 22:11:12,982 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1689459072256.d8eba43acbd0cee7d3fc2add2d7d9cf3. 2023-07-15 22:11:12,983 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=d8eba43acbd0cee7d3fc2add2d7d9cf3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:11:12,983 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1689459072256.d8eba43acbd0cee7d3fc2add2d7d9cf3.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689459072983"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689459072983"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689459072983"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689459072983"}]},"ts":"1689459072983"} 2023-07-15 22:11:12,992 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=14 2023-07-15 22:11:12,993 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=14, state=SUCCESS; OpenRegionProcedure d8eba43acbd0cee7d3fc2add2d7d9cf3, server=jenkins-hbase4.apache.org,38193,1689459063370 in 287 msec 2023-07-15 22:11:12,996 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=14, resume processing ppid=12 2023-07-15 22:11:12,998 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=d8eba43acbd0cee7d3fc2add2d7d9cf3, ASSIGN in 458 msec 2023-07-15 22:11:12,999 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-15 22:11:12,999 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689459072999"}]},"ts":"1689459072999"} 2023-07-15 22:11:13,001 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-07-15 22:11:13,005 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-07-15 22:11:13,012 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-07-15 22:11:13,041 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38193] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-15 22:11:13,103 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-15 22:11:13,103 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-15 22:11:13,103 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-15 22:11:13,105 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-15 22:11:13,105 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 22:11:13,137 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-15 22:11:13,143 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 881 msec 2023-07-15 22:11:13,150 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-15 22:11:13,151 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-15 22:11:13,152 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-15 22:11:13,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-15 22:11:13,408 INFO [Listener at jenkins-hbase4.apache.org/46535] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-07-15 22:11:13,408 DEBUG [Listener at jenkins-hbase4.apache.org/46535] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportWithTargetName get assigned. Timeout = 60000ms 2023-07-15 22:11:13,409 INFO [Listener at jenkins-hbase4.apache.org/46535] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 22:11:13,413 INFO [Listener at jenkins-hbase4.apache.org/46535] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportWithTargetName assigned to meta. Checking AM states. 2023-07-15 22:11:13,414 INFO [Listener at jenkins-hbase4.apache.org/46535] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 22:11:13,414 INFO [Listener at jenkins-hbase4.apache.org/46535] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportWithTargetName assigned. 2023-07-15 22:11:13,430 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-15 22:11:13,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689459073430 (current time:1689459073430). 2023-07-15 22:11:13,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 22:11:13,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] zookeeper.ReadOnlyZKClient(139): Connect 0x4e65ee3c to 127.0.0.1:53678 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 22:11:13,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@23d220c5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 22:11:13,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 22:11:13,441 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33382, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 22:11:13,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4e65ee3c to 127.0.0.1:53678 2023-07-15 22:11:13,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 22:11:13,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] zookeeper.ReadOnlyZKClient(139): Connect 0x76ebb6c8 to 127.0.0.1:53678 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 22:11:13,450 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@644cf153, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 22:11:13,452 DEBUG [hconnection-0x727c515d-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 22:11:13,455 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33384, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 22:11:13,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x76ebb6c8 to 127.0.0.1:53678 2023-07-15 22:11:13,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 22:11:13,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-15 22:11:13,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 22:11:13,489 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-15 22:11:13,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] procedure2.ProcedureExecutor(1029): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-15 22:11:13,520 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-15 22:11:13,522 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689459673522 2023-07-15 22:11:13,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-15 22:11:13,522 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-15 22:11:13,526 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-15 22:11:13,527 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-15 22:11:13,528 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 20 msec 2023-07-15 22:11:13,529 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-15 22:11:13,530 DEBUG [Listener at jenkins-hbase4.apache.org/46535] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 22:11:13,530 DEBUG [Listener at jenkins-hbase4.apache.org/46535] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 22:11:13,531 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689459673531 2023-07-15 22:11:13,556 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:13,557 INFO [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-07-15 22:11:13,557 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 22:11:13,558 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-07-15 22:11:13,558 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-15 22:11:13,559 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:13,559 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:13,563 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:11:13,563 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:11:13,563 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:13,563 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:11:13,563 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:11:13,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:11:13,563 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:11:13,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:11:13,563 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:11:13,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:11:13,564 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:13,564 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:11:13,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:13,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:13,564 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:11:13,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:13,564 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 22:11:13,565 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:13,565 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:13,565 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:13,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-15 22:11:13,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-15 22:11:13,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-15 22:11:13,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:13,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:13,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:13,566 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-15 22:11:13,566 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-15 22:11:13,566 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-15 22:11:13,569 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:13,569 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:13,569 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:13,569 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-15 22:11:13,570 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 22:11:13,571 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-15 22:11:13,571 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 22:11:13,571 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-15 22:11:13,572 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-15 22:11:13,572 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-15 22:11:13,572 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 22:11:13,572 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-15 22:11:13,572 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-15 22:11:13,573 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38193,1689459063370' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-15 22:11:13,573 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46037,1689459063224' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-15 22:11:13,573 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-15 22:11:13,573 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-15 22:11:13,573 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37287,1689459063311' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-15 22:11:13,576 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:13,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:13,576 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:13,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:11:13,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:11:13,582 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:13,582 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:13,582 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 22:11:13,583 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:13,583 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:13,583 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:11:13,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:11:13,583 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 22:11:13,584 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:13,584 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 22:11:13,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:11:13,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:13,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:11:13,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:13,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:13,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:11:13,587 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46037,1689459063224' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-15 22:11:13,587 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@39a519ea[Count = 1] remaining members to acquire global barrier 2023-07-15 22:11:13,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:11:13,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:11:13,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:11:13,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:11:13,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:11:13,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:13,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:11:13,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:13,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:13,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:11:13,591 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38193,1689459063370' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-15 22:11:13,591 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@39a519ea[Count = 0] remaining members to acquire global barrier 2023-07-15 22:11:13,591 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-15 22:11:13,591 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:13,596 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:13,596 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:13,596 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:13,596 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:13,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:13,596 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:13,596 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-15 22:11:13,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:13,596 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:13,596 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-15 22:11:13,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:13,596 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-15 22:11:13,596 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-15 22:11:13,597 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,37287,1689459063311' in zk 2023-07-15 22:11:13,597 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:13,598 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 22:11:13,598 DEBUG [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689459072256.5f0f9870744d546ed33237315d62fd5f. 2023-07-15 22:11:13,598 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 22:11:13,598 DEBUG [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689459072256.5f0f9870744d546ed33237315d62fd5f. started... 2023-07-15 22:11:13,600 DEBUG [rs(jenkins-hbase4.apache.org,38193,1689459063370)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689459072256.d8eba43acbd0cee7d3fc2add2d7d9cf3. 2023-07-15 22:11:13,600 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:11:13,600 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 22:11:13,600 DEBUG [rs(jenkins-hbase4.apache.org,38193,1689459063370)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689459072256.d8eba43acbd0cee7d3fc2add2d7d9cf3. started... 2023-07-15 22:11:13,600 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 22:11:13,607 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-15 22:11:13,607 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 22:11:13,607 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 22:11:13,608 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-15 22:11:13,613 DEBUG [rs(jenkins-hbase4.apache.org,38193,1689459063370)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d8eba43acbd0cee7d3fc2add2d7d9cf3: 2023-07-15 22:11:13,613 DEBUG [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5f0f9870744d546ed33237315d62fd5f: 2023-07-15 22:11:13,614 DEBUG [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689459072256.5f0f9870744d546ed33237315d62fd5f.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:13,614 DEBUG [rs(jenkins-hbase4.apache.org,38193,1689459063370)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689459072256.d8eba43acbd0cee7d3fc2add2d7d9cf3.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:13,620 DEBUG [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 22:11:13,622 DEBUG [rs(jenkins-hbase4.apache.org,38193,1689459063370)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 22:11:13,624 DEBUG [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-15 22:11:13,624 DEBUG [rs(jenkins-hbase4.apache.org,38193,1689459063370)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-15 22:11:13,632 DEBUG [Listener at jenkins-hbase4.apache.org/46535] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 22:11:13,638 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-15 22:11:13,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-15 22:11:13,641 DEBUG [Listener at jenkins-hbase4.apache.org/46535] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 22:11:13,682 DEBUG [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689459072256.5f0f9870744d546ed33237315d62fd5f. completed. 2023-07-15 22:11:13,682 DEBUG [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689459072256.5f0f9870744d546ed33237315d62fd5f. 2023-07-15 22:11:13,683 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 22:11:13,683 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 22:11:13,683 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:13,683 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-15 22:11:13,683 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,46037,1689459063224' in zk 2023-07-15 22:11:13,685 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-15 22:11:13,685 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:13,685 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 22:11:13,685 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-15 22:11:13,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:13,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:11:13,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:11:13,686 DEBUG [rs(jenkins-hbase4.apache.org,38193,1689459063370)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689459072256.d8eba43acbd0cee7d3fc2add2d7d9cf3. completed. 2023-07-15 22:11:13,686 DEBUG [rs(jenkins-hbase4.apache.org,38193,1689459063370)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689459072256.d8eba43acbd0cee7d3fc2add2d7d9cf3. 2023-07-15 22:11:13,686 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 22:11:13,686 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 22:11:13,686 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:11:13,686 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-15 22:11:13,686 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,38193,1689459063370' in zk 2023-07-15 22:11:13,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:11:13,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:11:13,688 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:11:13,688 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-15 22:11:13,688 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 22:11:13,688 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-15 22:11:13,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:13,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:11:13,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:13,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:13,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:11:13,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:13,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:11:13,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:13,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:13,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,46037,1689459063224': 2023-07-15 22:11:13,693 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46037,1689459063224' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-15 22:11:13,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:11:13,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:11:13,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:11:13,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:11:13,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:11:13,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:13,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:11:13,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:13,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:13,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:11:13,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:13,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:11:13,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:13,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:13,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,38193,1689459063370': 2023-07-15 22:11:13,698 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38193,1689459063370' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-15 22:11:13,698 INFO [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-07-15 22:11:13,698 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 22:11:13,698 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 22:11:13,698 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:13,699 INFO [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 22:11:13,702 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:13,702 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:13,702 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:11:13,702 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:11:13,702 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:13,703 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:13,703 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:13,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:13,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:13,703 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:11:13,702 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:13,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:13,702 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:13,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:13,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:11:13,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:11:13,703 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:11:13,703 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:11:13,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:11:13,704 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:11:13,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:11:13,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:11:13,706 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:11:13,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:13,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:13,707 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:13,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:13,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:11:13,707 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:13,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:13,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:11:13,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:13,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:11:13,710 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:11:13,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:13,711 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:13,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:13,711 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:13,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:11:13,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:13,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:11:13,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:13,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:13,725 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:11:13,725 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:11:13,725 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:11:13,725 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:11:13,725 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:11:13,725 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:11:13,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:11:13,725 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:11:13,725 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:13,726 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:11:13,726 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:11:13,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:11:13,726 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:13,726 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:13,726 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 22:11:13,726 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:11:13,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:11:13,727 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:13,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:11:13,727 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:11:13,726 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:13,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:11:13,727 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:11:13,727 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:13,727 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:13,727 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:13,727 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:13,727 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:11:13,727 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:13,727 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:13,727 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:11:13,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:11:13,729 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:13,768 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:13,811 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-15 22:11:13,811 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:13,812 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:13,812 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689459073522Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1689459073726 (+204 ms)Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1689459073727 (+1 ms)Writing data manifest for emptySnaptb0-testExportWithTargetName at 1689459073740 (+13 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1689459073757 (+17 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689459073811 (+54 ms) 2023-07-15 22:11:13,813 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-15 22:11:13,815 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 289 msec 2023-07-15 22:11:13,841 DEBUG [Listener at jenkins-hbase4.apache.org/46535] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 22:11:13,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-15 22:11:13,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 22:11:13,860 DEBUG [htable-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 22:11:13,865 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38193] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1689459072256.d8eba43acbd0cee7d3fc2add2d7d9cf3. with WAL disabled. Data may be lost in the event of a crash. 2023-07-15 22:11:13,869 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48222, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 22:11:13,870 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46037] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1689459072256.5f0f9870744d546ed33237315d62fd5f. with WAL disabled. Data may be lost in the event of a crash. 2023-07-15 22:11:13,875 DEBUG [Listener at jenkins-hbase4.apache.org/46535] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-15 22:11:13,876 DEBUG [Listener at jenkins-hbase4.apache.org/46535] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689459072256.5f0f9870744d546ed33237315d62fd5f. 2023-07-15 22:11:13,882 INFO [Listener at jenkins-hbase4.apache.org/46535] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 22:11:13,914 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-15 22:11:13,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689459073914 (current time:1689459073914). 2023-07-15 22:11:13,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 22:11:13,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] zookeeper.ReadOnlyZKClient(139): Connect 0x56005a31 to 127.0.0.1:53678 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 22:11:13,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1bd66544, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 22:11:13,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 22:11:13,924 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33400, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 22:11:13,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x56005a31 to 127.0.0.1:53678 2023-07-15 22:11:13,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 22:11:13,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] zookeeper.ReadOnlyZKClient(139): Connect 0x507b46d3 to 127.0.0.1:53678 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 22:11:13,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4fe5f3f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 22:11:13,932 DEBUG [hconnection-0x2c2af6a1-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 22:11:13,935 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33406, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 22:11:13,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x507b46d3 to 127.0.0.1:53678 2023-07-15 22:11:13,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 22:11:13,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-15 22:11:13,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 22:11:13,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-15 22:11:13,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-15 22:11:13,946 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-15 22:11:13,948 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689459673948 2023-07-15 22:11:13,948 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-15 22:11:13,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-15 22:11:13,949 DEBUG [Listener at jenkins-hbase4.apache.org/46535] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 22:11:13,950 DEBUG [Listener at jenkins-hbase4.apache.org/46535] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 22:11:13,951 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-15 22:11:13,951 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-15 22:11:13,956 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 7 msec 2023-07-15 22:11:13,957 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-15 22:11:13,958 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689459673958 2023-07-15 22:11:13,982 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-07-15 22:11:13,982 INFO [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-07-15 22:11:13,982 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 22:11:13,983 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-07-15 22:11:13,983 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-15 22:11:13,984 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 22:11:13,984 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-15 22:11:13,986 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:11:13,986 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:11:13,986 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:11:13,986 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:11:13,986 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:11:13,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:11:13,986 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:13,986 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:11:13,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:11:13,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-15 22:11:13,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:11:13,987 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:13,987 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:11:13,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-15 22:11:13,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-15 22:11:13,988 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 22:11:13,988 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 22:11:13,988 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:11:13,988 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 22:11:13,988 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 22:11:13,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-15 22:11:13,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-15 22:11:13,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-15 22:11:13,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-15 22:11:13,989 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-15 22:11:13,989 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-15 22:11:13,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-15 22:11:13,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-15 22:11:13,989 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-15 22:11:13,989 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-15 22:11:13,989 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-15 22:11:13,989 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-15 22:11:13,989 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-15 22:11:13,989 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 22:11:13,989 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 22:11:13,990 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-15 22:11:13,991 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-15 22:11:13,991 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-15 22:11:13,989 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-15 22:11:13,991 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38193,1689459063370' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-15 22:11:13,991 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-15 22:11:13,992 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 22:11:13,991 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-15 22:11:13,992 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-15 22:11:13,992 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-15 22:11:13,992 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46037,1689459063224' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-15 22:11:13,992 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37287,1689459063311' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-15 22:11:13,995 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 22:11:13,995 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:11:13,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:11:13,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:11:13,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:11:13,996 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 22:11:13,996 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 22:11:13,996 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 22:11:14,001 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 22:11:14,001 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 22:11:14,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:11:14,001 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 22:11:14,001 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:14,002 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 22:11:14,002 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 22:11:14,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:11:14,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-15 22:11:14,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:11:14,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:14,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:14,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:11:14,004 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38193,1689459063370' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-15 22:11:14,004 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@9f425e1[Count = 1] remaining members to acquire global barrier 2023-07-15 22:11:14,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:14,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:11:14,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:11:14,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:11:14,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:11:14,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-15 22:11:14,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:11:14,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:14,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:14,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:11:14,007 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46037,1689459063224' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-15 22:11:14,007 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@9f425e1[Count = 0] remaining members to acquire global barrier 2023-07-15 22:11:14,007 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-15 22:11:14,007 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 22:11:14,011 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 22:11:14,011 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 22:11:14,011 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 22:11:14,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 22:11:14,011 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 22:11:14,011 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-15 22:11:14,011 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 22:11:14,011 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 22:11:14,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 22:11:14,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 22:11:14,011 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 22:11:14,011 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 22:11:14,011 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-15 22:11:14,012 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-15 22:11:14,011 DEBUG [rs(jenkins-hbase4.apache.org,38193,1689459063370)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689459072256.d8eba43acbd0cee7d3fc2add2d7d9cf3. 2023-07-15 22:11:14,012 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 22:11:14,012 DEBUG [rs(jenkins-hbase4.apache.org,38193,1689459063370)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689459072256.d8eba43acbd0cee7d3fc2add2d7d9cf3. started... 2023-07-15 22:11:14,012 DEBUG [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689459072256.5f0f9870744d546ed33237315d62fd5f. 2023-07-15 22:11:14,012 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 22:11:14,012 INFO [rs(jenkins-hbase4.apache.org,38193,1689459063370)-snapshot-pool-0] regionserver.HRegion(2745): Flushing d8eba43acbd0cee7d3fc2add2d7d9cf3 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-15 22:11:14,012 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-15 22:11:14,012 DEBUG [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689459072256.5f0f9870744d546ed33237315d62fd5f. started... 2023-07-15 22:11:14,014 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,37287,1689459063311' in zk 2023-07-15 22:11:14,014 INFO [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 5f0f9870744d546ed33237315d62fd5f 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-15 22:11:14,017 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:11:14,017 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-15 22:11:14,017 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 22:11:14,017 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-15 22:11:14,018 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:14,018 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 22:11:14,050 DEBUG [Listener at jenkins-hbase4.apache.org/46535] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 22:11:14,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-15 22:11:14,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-15 22:11:14,052 DEBUG [Listener at jenkins-hbase4.apache.org/46535] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 22:11:14,132 INFO [rs(jenkins-hbase4.apache.org,38193,1689459063370)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.06 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportWithTargetName/d8eba43acbd0cee7d3fc2add2d7d9cf3/.tmp/cf/1f4d2d60d5c64337b21ef7e3bd63a9fb 2023-07-15 22:11:14,132 INFO [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=199 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportWithTargetName/5f0f9870744d546ed33237315d62fd5f/.tmp/cf/c57fca90435b4538809717a9de05ad6f 2023-07-15 22:11:14,184 DEBUG [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportWithTargetName/5f0f9870744d546ed33237315d62fd5f/.tmp/cf/c57fca90435b4538809717a9de05ad6f as hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportWithTargetName/5f0f9870744d546ed33237315d62fd5f/cf/c57fca90435b4538809717a9de05ad6f 2023-07-15 22:11:14,184 DEBUG [rs(jenkins-hbase4.apache.org,38193,1689459063370)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportWithTargetName/d8eba43acbd0cee7d3fc2add2d7d9cf3/.tmp/cf/1f4d2d60d5c64337b21ef7e3bd63a9fb as hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportWithTargetName/d8eba43acbd0cee7d3fc2add2d7d9cf3/cf/1f4d2d60d5c64337b21ef7e3bd63a9fb 2023-07-15 22:11:14,195 INFO [rs(jenkins-hbase4.apache.org,38193,1689459063370)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportWithTargetName/d8eba43acbd0cee7d3fc2add2d7d9cf3/cf/1f4d2d60d5c64337b21ef7e3bd63a9fb, entries=47, sequenceid=6, filesize=8.0 K 2023-07-15 22:11:14,195 INFO [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportWithTargetName/5f0f9870744d546ed33237315d62fd5f/cf/c57fca90435b4538809717a9de05ad6f, entries=3, sequenceid=6, filesize=5.0 K 2023-07-15 22:11:14,199 INFO [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 5f0f9870744d546ed33237315d62fd5f in 185ms, sequenceid=6, compaction requested=false 2023-07-15 22:11:14,199 INFO [rs(jenkins-hbase4.apache.org,38193,1689459063370)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for d8eba43acbd0cee7d3fc2add2d7d9cf3 in 187ms, sequenceid=6, compaction requested=false 2023-07-15 22:11:14,199 DEBUG [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-15 22:11:14,199 DEBUG [rs(jenkins-hbase4.apache.org,38193,1689459063370)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-15 22:11:14,202 DEBUG [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5f0f9870744d546ed33237315d62fd5f: 2023-07-15 22:11:14,202 DEBUG [rs(jenkins-hbase4.apache.org,38193,1689459063370)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d8eba43acbd0cee7d3fc2add2d7d9cf3: 2023-07-15 22:11:14,202 DEBUG [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689459072256.5f0f9870744d546ed33237315d62fd5f.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-15 22:11:14,202 DEBUG [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 22:11:14,202 DEBUG [rs(jenkins-hbase4.apache.org,38193,1689459063370)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689459072256.d8eba43acbd0cee7d3fc2add2d7d9cf3.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-15 22:11:14,202 DEBUG [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportWithTargetName/5f0f9870744d546ed33237315d62fd5f/cf/c57fca90435b4538809717a9de05ad6f] hfiles 2023-07-15 22:11:14,202 DEBUG [rs(jenkins-hbase4.apache.org,38193,1689459063370)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 22:11:14,202 DEBUG [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportWithTargetName/5f0f9870744d546ed33237315d62fd5f/cf/c57fca90435b4538809717a9de05ad6f for snapshot=snaptb0-testExportWithTargetName 2023-07-15 22:11:14,203 DEBUG [rs(jenkins-hbase4.apache.org,38193,1689459063370)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportWithTargetName/d8eba43acbd0cee7d3fc2add2d7d9cf3/cf/1f4d2d60d5c64337b21ef7e3bd63a9fb] hfiles 2023-07-15 22:11:14,203 DEBUG [rs(jenkins-hbase4.apache.org,38193,1689459063370)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportWithTargetName/d8eba43acbd0cee7d3fc2add2d7d9cf3/cf/1f4d2d60d5c64337b21ef7e3bd63a9fb for snapshot=snaptb0-testExportWithTargetName 2023-07-15 22:11:14,227 DEBUG [rs(jenkins-hbase4.apache.org,38193,1689459063370)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689459072256.d8eba43acbd0cee7d3fc2add2d7d9cf3. completed. 2023-07-15 22:11:14,227 DEBUG [rs(jenkins-hbase4.apache.org,38193,1689459063370)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689459072256.d8eba43acbd0cee7d3fc2add2d7d9cf3. 2023-07-15 22:11:14,227 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 22:11:14,227 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 22:11:14,227 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:11:14,227 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-15 22:11:14,227 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,38193,1689459063370' in zk 2023-07-15 22:11:14,227 DEBUG [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689459072256.5f0f9870744d546ed33237315d62fd5f. completed. 2023-07-15 22:11:14,227 DEBUG [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689459072256.5f0f9870744d546ed33237315d62fd5f. 2023-07-15 22:11:14,227 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 22:11:14,227 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 22:11:14,227 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:14,228 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-15 22:11:14,228 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,46037,1689459063224' in zk 2023-07-15 22:11:14,229 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:11:14,229 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-15 22:11:14,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:11:14,229 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 22:11:14,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:11:14,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:11:14,230 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-15 22:11:14,231 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-15 22:11:14,231 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:14,231 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 22:11:14,231 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-15 22:11:14,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:11:14,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:11:14,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-15 22:11:14,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:11:14,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:14,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:14,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:11:14,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-15 22:11:14,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:11:14,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:14,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:14,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,38193,1689459063370': 2023-07-15 22:11:14,236 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38193,1689459063370' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-15 22:11:14,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:14,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:11:14,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:11:14,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:11:14,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:11:14,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-15 22:11:14,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:11:14,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:14,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:14,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:11:14,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-15 22:11:14,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:11:14,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:14,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:14,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,46037,1689459063224': 2023-07-15 22:11:14,241 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46037,1689459063224' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-15 22:11:14,241 INFO [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-07-15 22:11:14,241 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 22:11:14,241 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 22:11:14,241 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-07-15 22:11:14,242 INFO [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 22:11:14,244 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 22:11:14,244 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 22:11:14,244 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 22:11:14,244 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:11:14,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 22:11:14,244 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 22:11:14,244 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 22:11:14,244 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:11:14,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 22:11:14,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:11:14,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:11:14,244 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 22:11:14,244 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:11:14,244 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:11:14,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:11:14,244 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 22:11:14,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 22:11:14,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 22:11:14,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:11:14,245 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:11:14,245 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:11:14,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:11:14,245 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:11:14,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 22:11:14,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:11:14,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-15 22:11:14,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 22:11:14,246 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:14,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 22:11:14,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:11:14,246 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:14,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-15 22:11:14,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:11:14,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:14,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:14,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:11:14,248 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:11:14,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-15 22:11:14,249 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:14,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:11:14,249 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:14,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:14,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:14,252 DEBUG [Listener at jenkins-hbase4.apache.org/46535] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 22:11:14,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-15 22:11:14,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-15 22:11:14,261 DEBUG [Listener at jenkins-hbase4.apache.org/46535] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-15 22:11:14,262 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:14,262 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:11:14,262 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-15 22:11:14,262 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:11:14,262 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:14,262 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:11:14,262 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:11:14,262 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:11:14,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:11:14,262 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-07-15 22:11:14,262 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:11:14,263 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-07-15 22:11:14,263 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:11:14,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:11:14,263 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:11:14,262 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 22:11:14,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:11:14,262 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:11:14,262 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:11:14,264 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-15 22:11:14,264 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:11:14,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:11:14,264 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:14,264 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:11:14,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:11:14,264 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 22:11:14,264 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:11:14,264 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:14,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:11:14,264 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:11:14,265 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 22:11:14,265 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 22:11:14,265 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-15 22:11:14,309 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-15 22:11:14,367 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-15 22:11:14,367 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-15 22:11:14,368 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-15 22:11:14,368 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689459073948Consolidate snapshot: snaptb0-testExportWithTargetName at 1689459074263 (+315 ms)Loading Region manifests for snaptb0-testExportWithTargetName at 1689459074263Writing data manifest for snaptb0-testExportWithTargetName at 1689459074269 (+6 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1689459074296 (+27 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689459074367 (+71 ms) 2023-07-15 22:11:14,370 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-15 22:11:14,373 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 421 msec 2023-07-15 22:11:14,561 DEBUG [Listener at jenkins-hbase4.apache.org/46535] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 22:11:14,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-15 22:11:14,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 22:11:14,564 INFO [Listener at jenkins-hbase4.apache.org/46535] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/export-test/export-1689459074564 2023-07-15 22:11:14,565 INFO [Listener at jenkins-hbase4.apache.org/46535] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:33847, tgtDir=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/export-test/export-1689459074564, rawTgtDir=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/export-test/export-1689459074564, srcFsUri=hdfs://localhost:33847, srcDir=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e 2023-07-15 22:11:14,603 DEBUG [Listener at jenkins-hbase4.apache.org/46535] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:33847, inputRoot=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e 2023-07-15 22:11:14,603 DEBUG [Listener at jenkins-hbase4.apache.org/46535] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_132146614_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/export-test/export-1689459074564, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/export-test/export-1689459074564/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-15 22:11:14,604 INFO [Listener at jenkins-hbase4.apache.org/46535] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:33847, inputRoot=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e, snapshotDir=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-07-15 22:11:14,621 INFO [Listener at jenkins-hbase4.apache.org/46535] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/export-test/export-1689459074564/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-15 22:11:14,716 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-15 22:11:14,716 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-15 22:11:14,717 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-15 22:11:14,717 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-15 22:11:14,718 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-15 22:11:14,718 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-15 22:11:14,719 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-15 22:11:14,800 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97e758c6-fe86-0ed9-092f-cd0594d33e04/hadoop-5536575537471426775.jar 2023-07-15 22:11:14,801 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-15 22:11:14,801 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-15 22:11:14,802 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-15 22:11:14,802 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-15 22:11:14,803 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-15 22:11:14,803 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-15 22:11:14,804 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-15 22:11:14,805 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-15 22:11:14,806 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-15 22:11:14,807 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-15 22:11:14,807 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-15 22:11:14,808 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-15 22:11:14,809 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-15 22:11:14,809 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-15 22:11:14,810 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-15 22:11:14,810 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-15 22:11:14,813 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 22:11:14,813 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 22:11:14,814 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 22:11:14,814 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 22:11:14,814 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 22:11:14,815 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 22:11:14,815 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 22:11:15,856 WARN [Listener at jenkins-hbase4.apache.org/46535] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-15 22:11:15,873 INFO [Listener at jenkins-hbase4.apache.org/46535] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-07-15 22:11:15,884 DEBUG [Listener at jenkins-hbase4.apache.org/46535] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-15 22:11:16,384 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 22:11:16,385 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 22:11:16,863 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689459070788_0001_000001 (auth:SIMPLE) 2023-07-15 22:11:18,389 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-15 22:11:22,133 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689459070788_0001_000001 (auth:SIMPLE) 2023-07-15 22:11:24,468 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689459070788_0001_000001 (auth:SIMPLE) 2023-07-15 22:11:27,061 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689459070788_0001_000001 (auth:SIMPLE) 2023-07-15 22:11:28,846 INFO [Listener at jenkins-hbase4.apache.org/46535] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-15 22:11:28,850 INFO [Listener at jenkins-hbase4.apache.org/46535] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-15 22:11:28,860 INFO [Listener at jenkins-hbase4.apache.org/46535] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-07-15 22:11:28,860 INFO [Listener at jenkins-hbase4.apache.org/46535] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-15 22:11:28,861 INFO [Listener at jenkins-hbase4.apache.org/46535] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-15 22:11:28,861 DEBUG [Listener at jenkins-hbase4.apache.org/46535] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2077448059_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-15 22:11:28,861 DEBUG [Listener at jenkins-hbase4.apache.org/46535] snapshot.TestExportSnapshot(367): hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-07-15 22:11:28,861 DEBUG [Listener at jenkins-hbase4.apache.org/46535] snapshot.TestExportSnapshot(367): hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-07-15 22:11:28,861 DEBUG [Listener at jenkins-hbase4.apache.org/46535] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2077448059_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/export-test/export-1689459074564/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/export-test/export-1689459074564/.hbase-snapshot/testExportWithTargetName 2023-07-15 22:11:28,862 DEBUG [Listener at jenkins-hbase4.apache.org/46535] snapshot.TestExportSnapshot(367): hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/export-test/export-1689459074564/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-07-15 22:11:28,862 DEBUG [Listener at jenkins-hbase4.apache.org/46535] snapshot.TestExportSnapshot(367): hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/export-test/export-1689459074564/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-07-15 22:11:28,872 INFO [Listener at jenkins-hbase4.apache.org/46535] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-07-15 22:11:28,878 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-07-15 22:11:28,889 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-07-15 22:11:28,894 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689459088894"}]},"ts":"1689459088894"} 2023-07-15 22:11:28,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-15 22:11:28,897 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-07-15 22:11:28,899 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-07-15 22:11:28,900 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5f0f9870744d546ed33237315d62fd5f, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=d8eba43acbd0cee7d3fc2add2d7d9cf3, UNASSIGN}] 2023-07-15 22:11:28,903 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5f0f9870744d546ed33237315d62fd5f, UNASSIGN 2023-07-15 22:11:28,903 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=d8eba43acbd0cee7d3fc2add2d7d9cf3, UNASSIGN 2023-07-15 22:11:28,904 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=5f0f9870744d546ed33237315d62fd5f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:28,904 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689459072256.5f0f9870744d546ed33237315d62fd5f.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689459088904"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689459088904"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689459088904"}]},"ts":"1689459088904"} 2023-07-15 22:11:28,904 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=d8eba43acbd0cee7d3fc2add2d7d9cf3, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:11:28,904 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689459072256.d8eba43acbd0cee7d3fc2add2d7d9cf3.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689459088904"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689459088904"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689459088904"}]},"ts":"1689459088904"} 2023-07-15 22:11:28,906 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=22, state=RUNNABLE; CloseRegionProcedure 5f0f9870744d546ed33237315d62fd5f, server=jenkins-hbase4.apache.org,46037,1689459063224}] 2023-07-15 22:11:28,907 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; CloseRegionProcedure d8eba43acbd0cee7d3fc2add2d7d9cf3, server=jenkins-hbase4.apache.org,38193,1689459063370}] 2023-07-15 22:11:28,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-15 22:11:29,067 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 5f0f9870744d546ed33237315d62fd5f 2023-07-15 22:11:29,067 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close d8eba43acbd0cee7d3fc2add2d7d9cf3 2023-07-15 22:11:29,067 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 5f0f9870744d546ed33237315d62fd5f, disabling compactions & flushes 2023-07-15 22:11:29,067 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d8eba43acbd0cee7d3fc2add2d7d9cf3, disabling compactions & flushes 2023-07-15 22:11:29,067 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689459072256.5f0f9870744d546ed33237315d62fd5f. 2023-07-15 22:11:29,067 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689459072256.d8eba43acbd0cee7d3fc2add2d7d9cf3. 2023-07-15 22:11:29,067 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689459072256.5f0f9870744d546ed33237315d62fd5f. 2023-07-15 22:11:29,067 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689459072256.d8eba43acbd0cee7d3fc2add2d7d9cf3. 2023-07-15 22:11:29,067 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689459072256.5f0f9870744d546ed33237315d62fd5f. after waiting 0 ms 2023-07-15 22:11:29,068 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689459072256.d8eba43acbd0cee7d3fc2add2d7d9cf3. after waiting 0 ms 2023-07-15 22:11:29,068 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689459072256.d8eba43acbd0cee7d3fc2add2d7d9cf3. 2023-07-15 22:11:29,068 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689459072256.5f0f9870744d546ed33237315d62fd5f. 2023-07-15 22:11:29,083 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportWithTargetName/5f0f9870744d546ed33237315d62fd5f/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 22:11:29,083 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportWithTargetName/d8eba43acbd0cee7d3fc2add2d7d9cf3/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 22:11:29,084 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 22:11:29,084 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 22:11:29,086 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689459072256.5f0f9870744d546ed33237315d62fd5f. 2023-07-15 22:11:29,086 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689459072256.d8eba43acbd0cee7d3fc2add2d7d9cf3. 2023-07-15 22:11:29,087 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 5f0f9870744d546ed33237315d62fd5f: 2023-07-15 22:11:29,087 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d8eba43acbd0cee7d3fc2add2d7d9cf3: 2023-07-15 22:11:29,091 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 5f0f9870744d546ed33237315d62fd5f 2023-07-15 22:11:29,093 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=5f0f9870744d546ed33237315d62fd5f, regionState=CLOSED 2023-07-15 22:11:29,093 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689459072256.5f0f9870744d546ed33237315d62fd5f.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689459089093"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689459089093"}]},"ts":"1689459089093"} 2023-07-15 22:11:29,097 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed d8eba43acbd0cee7d3fc2add2d7d9cf3 2023-07-15 22:11:29,097 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=d8eba43acbd0cee7d3fc2add2d7d9cf3, regionState=CLOSED 2023-07-15 22:11:29,098 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689459072256.d8eba43acbd0cee7d3fc2add2d7d9cf3.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689459089097"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689459089097"}]},"ts":"1689459089097"} 2023-07-15 22:11:29,105 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=22 2023-07-15 22:11:29,105 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=22, state=SUCCESS; CloseRegionProcedure 5f0f9870744d546ed33237315d62fd5f, server=jenkins-hbase4.apache.org,46037,1689459063224 in 193 msec 2023-07-15 22:11:29,115 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=23 2023-07-15 22:11:29,115 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=23, state=SUCCESS; CloseRegionProcedure d8eba43acbd0cee7d3fc2add2d7d9cf3, server=jenkins-hbase4.apache.org,38193,1689459063370 in 193 msec 2023-07-15 22:11:29,115 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5f0f9870744d546ed33237315d62fd5f, UNASSIGN in 205 msec 2023-07-15 22:11:29,119 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=21 2023-07-15 22:11:29,119 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=d8eba43acbd0cee7d3fc2add2d7d9cf3, UNASSIGN in 215 msec 2023-07-15 22:11:29,120 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689459089120"}]},"ts":"1689459089120"} 2023-07-15 22:11:29,122 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-07-15 22:11:29,126 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-07-15 22:11:29,134 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 250 msec 2023-07-15 22:11:29,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-15 22:11:29,198 INFO [Listener at jenkins-hbase4.apache.org/46535] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-07-15 22:11:29,205 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-07-15 22:11:29,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-15 22:11:29,219 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-15 22:11:29,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-07-15 22:11:29,223 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-15 22:11:29,226 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38193] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-07-15 22:11:29,232 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-15 22:11:29,232 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-15 22:11:29,232 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-15 22:11:29,232 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-15 22:11:29,235 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testExportWithTargetName/5f0f9870744d546ed33237315d62fd5f 2023-07-15 22:11:29,235 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testExportWithTargetName/d8eba43acbd0cee7d3fc2add2d7d9cf3 2023-07-15 22:11:29,235 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 22:11:29,235 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 22:11:29,235 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 22:11:29,235 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-15 22:11:29,236 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-15 22:11:29,236 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-15 22:11:29,236 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-15 22:11:29,236 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-15 22:11:29,236 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-15 22:11:29,237 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 22:11:29,237 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-15 22:11:29,237 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-15 22:11:29,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-15 22:11:29,242 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testExportWithTargetName/5f0f9870744d546ed33237315d62fd5f/cf, FileablePath, hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testExportWithTargetName/5f0f9870744d546ed33237315d62fd5f/recovered.edits] 2023-07-15 22:11:29,249 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testExportWithTargetName/d8eba43acbd0cee7d3fc2add2d7d9cf3/cf, FileablePath, hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testExportWithTargetName/d8eba43acbd0cee7d3fc2add2d7d9cf3/recovered.edits] 2023-07-15 22:11:29,260 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testExportWithTargetName/d8eba43acbd0cee7d3fc2add2d7d9cf3/cf/1f4d2d60d5c64337b21ef7e3bd63a9fb to hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/archive/data/default/testtb-testExportWithTargetName/d8eba43acbd0cee7d3fc2add2d7d9cf3/cf/1f4d2d60d5c64337b21ef7e3bd63a9fb 2023-07-15 22:11:29,265 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testExportWithTargetName/5f0f9870744d546ed33237315d62fd5f/cf/c57fca90435b4538809717a9de05ad6f to hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/archive/data/default/testtb-testExportWithTargetName/5f0f9870744d546ed33237315d62fd5f/cf/c57fca90435b4538809717a9de05ad6f 2023-07-15 22:11:29,270 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testExportWithTargetName/5f0f9870744d546ed33237315d62fd5f/recovered.edits/9.seqid to hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/archive/data/default/testtb-testExportWithTargetName/5f0f9870744d546ed33237315d62fd5f/recovered.edits/9.seqid 2023-07-15 22:11:29,270 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testExportWithTargetName/5f0f9870744d546ed33237315d62fd5f 2023-07-15 22:11:29,271 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testExportWithTargetName/d8eba43acbd0cee7d3fc2add2d7d9cf3/recovered.edits/9.seqid to hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/archive/data/default/testtb-testExportWithTargetName/d8eba43acbd0cee7d3fc2add2d7d9cf3/recovered.edits/9.seqid 2023-07-15 22:11:29,272 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testExportWithTargetName/d8eba43acbd0cee7d3fc2add2d7d9cf3 2023-07-15 22:11:29,272 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-15 22:11:29,275 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-15 22:11:29,306 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-07-15 22:11:29,311 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-07-15 22:11:29,313 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-15 22:11:29,313 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-07-15 22:11:29,313 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1689459072256.5f0f9870744d546ed33237315d62fd5f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689459089313"}]},"ts":"9223372036854775807"} 2023-07-15 22:11:29,314 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1689459072256.d8eba43acbd0cee7d3fc2add2d7d9cf3.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689459089313"}]},"ts":"9223372036854775807"} 2023-07-15 22:11:29,317 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-15 22:11:29,317 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 5f0f9870744d546ed33237315d62fd5f, NAME => 'testtb-testExportWithTargetName,,1689459072256.5f0f9870744d546ed33237315d62fd5f.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => d8eba43acbd0cee7d3fc2add2d7d9cf3, NAME => 'testtb-testExportWithTargetName,1,1689459072256.d8eba43acbd0cee7d3fc2add2d7d9cf3.', STARTKEY => '1', ENDKEY => ''}] 2023-07-15 22:11:29,317 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-07-15 22:11:29,317 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689459089317"}]},"ts":"9223372036854775807"} 2023-07-15 22:11:29,320 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-07-15 22:11:29,323 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-15 22:11:29,326 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 116 msec 2023-07-15 22:11:29,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-15 22:11:29,341 INFO [Listener at jenkins-hbase4.apache.org/46535] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-07-15 22:11:29,364 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-07-15 22:11:29,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-07-15 22:11:29,372 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-07-15 22:11:29,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-07-15 22:11:29,422 INFO [Listener at jenkins-hbase4.apache.org/46535] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportWithTargetName Thread=751 (was 703) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1279 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97e758c6-fe86-0ed9-092f-cd0594d33e04/cluster_fd3e249f-a612-98a2-a131-09cf78600e25/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97e758c6-fe86-0ed9-092f-cd0594d33e04/cluster_fd3e249f-a612-98a2-a131-09cf78600e25/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (905985230) connection to jenkins-hbase4.apache.org/172.31.14.131:38439 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1304503951_1 at /127.0.0.1:36994 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x57410306-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2077448059_17 at /127.0.0.1:37006 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97e758c6-fe86-0ed9-092f-cd0594d33e04/cluster_fd3e249f-a612-98a2-a131-09cf78600e25/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1304503951_1 at /127.0.0.1:45268 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x57410306-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x57410306-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97e758c6-fe86-0ed9-092f-cd0594d33e04/cluster_fd3e249f-a612-98a2-a131-09cf78600e25/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: RS-EventLoopGroup-3-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2077448059_17 at /127.0.0.1:45292 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97e758c6-fe86-0ed9-092f-cd0594d33e04/cluster_fd3e249f-a612-98a2-a131-09cf78600e25/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x57410306-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (905985230) connection to jenkins-hbase4.apache.org/172.31.14.131:34753 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97e758c6-fe86-0ed9-092f-cd0594d33e04/cluster_fd3e249f-a612-98a2-a131-09cf78600e25/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2077448059_17 at /127.0.0.1:60882 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=912 (was 893) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=292 (was 259) - SystemLoadAverage LEAK? -, ProcessCount=183 (was 174) - ProcessCount LEAK? -, AvailableMemoryMB=2880 (was 4914) 2023-07-15 22:11:29,423 WARN [Listener at jenkins-hbase4.apache.org/46535] hbase.ResourceChecker(130): Thread=751 is superior to 500 2023-07-15 22:11:29,448 INFO [Listener at jenkins-hbase4.apache.org/46535] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemState Thread=751, OpenFileDescriptor=912, MaxFileDescriptor=60000, SystemLoadAverage=292, ProcessCount=183, AvailableMemoryMB=2852 2023-07-15 22:11:29,448 WARN [Listener at jenkins-hbase4.apache.org/46535] hbase.ResourceChecker(130): Thread=751 is superior to 500 2023-07-15 22:11:29,451 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-15 22:11:29,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-07-15 22:11:29,458 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-15 22:11:29,458 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-07-15 22:11:29,459 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-15 22:11:29,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-15 22:11:29,462 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testExportFileSystemState/18ace9a1aade05fc0f7d9e4c10da84bc 2023-07-15 22:11:29,462 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testExportFileSystemState/eb451d60f8057a5a728f1cd282375776 2023-07-15 22:11:29,463 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testExportFileSystemState/18ace9a1aade05fc0f7d9e4c10da84bc empty. 2023-07-15 22:11:29,463 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testExportFileSystemState/eb451d60f8057a5a728f1cd282375776 empty. 2023-07-15 22:11:29,463 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testExportFileSystemState/18ace9a1aade05fc0f7d9e4c10da84bc 2023-07-15 22:11:29,464 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testExportFileSystemState/eb451d60f8057a5a728f1cd282375776 2023-07-15 22:11:29,464 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-15 22:11:29,491 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-15 22:11:29,492 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 18ace9a1aade05fc0f7d9e4c10da84bc, NAME => 'testtb-testExportFileSystemState,,1689459089451.18ace9a1aade05fc0f7d9e4c10da84bc.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp 2023-07-15 22:11:29,492 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => eb451d60f8057a5a728f1cd282375776, NAME => 'testtb-testExportFileSystemState,1,1689459089451.eb451d60f8057a5a728f1cd282375776.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp 2023-07-15 22:11:29,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-15 22:11:29,583 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689459089451.eb451d60f8057a5a728f1cd282375776.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 22:11:29,583 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689459089451.18ace9a1aade05fc0f7d9e4c10da84bc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 22:11:29,584 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing eb451d60f8057a5a728f1cd282375776, disabling compactions & flushes 2023-07-15 22:11:29,584 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 18ace9a1aade05fc0f7d9e4c10da84bc, disabling compactions & flushes 2023-07-15 22:11:29,584 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689459089451.eb451d60f8057a5a728f1cd282375776. 2023-07-15 22:11:29,584 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689459089451.18ace9a1aade05fc0f7d9e4c10da84bc. 2023-07-15 22:11:29,584 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689459089451.eb451d60f8057a5a728f1cd282375776. 2023-07-15 22:11:29,584 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689459089451.18ace9a1aade05fc0f7d9e4c10da84bc. 2023-07-15 22:11:29,584 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689459089451.eb451d60f8057a5a728f1cd282375776. after waiting 0 ms 2023-07-15 22:11:29,584 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689459089451.18ace9a1aade05fc0f7d9e4c10da84bc. after waiting 0 ms 2023-07-15 22:11:29,584 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689459089451.eb451d60f8057a5a728f1cd282375776. 2023-07-15 22:11:29,584 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689459089451.18ace9a1aade05fc0f7d9e4c10da84bc. 2023-07-15 22:11:29,584 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689459089451.eb451d60f8057a5a728f1cd282375776. 2023-07-15 22:11:29,584 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689459089451.18ace9a1aade05fc0f7d9e4c10da84bc. 2023-07-15 22:11:29,584 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for eb451d60f8057a5a728f1cd282375776: 2023-07-15 22:11:29,585 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 18ace9a1aade05fc0f7d9e4c10da84bc: 2023-07-15 22:11:29,588 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-15 22:11:29,589 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689459089451.eb451d60f8057a5a728f1cd282375776.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689459089589"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689459089589"}]},"ts":"1689459089589"} 2023-07-15 22:11:29,589 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689459089451.18ace9a1aade05fc0f7d9e4c10da84bc.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689459089589"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689459089589"}]},"ts":"1689459089589"} 2023-07-15 22:11:29,593 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-15 22:11:29,594 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-15 22:11:29,595 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689459089595"}]},"ts":"1689459089595"} 2023-07-15 22:11:29,596 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-07-15 22:11:29,603 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-15 22:11:29,604 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-15 22:11:29,604 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-15 22:11:29,605 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-15 22:11:29,605 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-15 22:11:29,605 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=18ace9a1aade05fc0f7d9e4c10da84bc, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=eb451d60f8057a5a728f1cd282375776, ASSIGN}] 2023-07-15 22:11:29,608 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=eb451d60f8057a5a728f1cd282375776, ASSIGN 2023-07-15 22:11:29,608 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=18ace9a1aade05fc0f7d9e4c10da84bc, ASSIGN 2023-07-15 22:11:29,610 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=eb451d60f8057a5a728f1cd282375776, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46037,1689459063224; forceNewPlan=false, retain=false 2023-07-15 22:11:29,610 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=18ace9a1aade05fc0f7d9e4c10da84bc, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37287,1689459063311; forceNewPlan=false, retain=false 2023-07-15 22:11:29,760 INFO [jenkins-hbase4:42893] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-15 22:11:29,763 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=eb451d60f8057a5a728f1cd282375776, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:29,763 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=18ace9a1aade05fc0f7d9e4c10da84bc, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:29,763 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689459089451.eb451d60f8057a5a728f1cd282375776.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689459089762"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689459089762"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689459089762"}]},"ts":"1689459089762"} 2023-07-15 22:11:29,763 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689459089451.18ace9a1aade05fc0f7d9e4c10da84bc.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689459089762"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689459089762"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689459089762"}]},"ts":"1689459089762"} 2023-07-15 22:11:29,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-15 22:11:29,765 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=29, state=RUNNABLE; OpenRegionProcedure eb451d60f8057a5a728f1cd282375776, server=jenkins-hbase4.apache.org,46037,1689459063224}] 2023-07-15 22:11:29,766 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=28, state=RUNNABLE; OpenRegionProcedure 18ace9a1aade05fc0f7d9e4c10da84bc, server=jenkins-hbase4.apache.org,37287,1689459063311}] 2023-07-15 22:11:29,919 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:29,919 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-15 22:11:29,923 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45754, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-15 22:11:29,928 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1689459089451.eb451d60f8057a5a728f1cd282375776. 2023-07-15 22:11:29,928 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => eb451d60f8057a5a728f1cd282375776, NAME => 'testtb-testExportFileSystemState,1,1689459089451.eb451d60f8057a5a728f1cd282375776.', STARTKEY => '1', ENDKEY => ''} 2023-07-15 22:11:29,929 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1689459089451.eb451d60f8057a5a728f1cd282375776. service=AccessControlService 2023-07-15 22:11:29,929 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 22:11:29,929 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState eb451d60f8057a5a728f1cd282375776 2023-07-15 22:11:29,930 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689459089451.eb451d60f8057a5a728f1cd282375776.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 22:11:29,930 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for eb451d60f8057a5a728f1cd282375776 2023-07-15 22:11:29,930 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for eb451d60f8057a5a728f1cd282375776 2023-07-15 22:11:29,931 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1689459089451.18ace9a1aade05fc0f7d9e4c10da84bc. 2023-07-15 22:11:29,931 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 18ace9a1aade05fc0f7d9e4c10da84bc, NAME => 'testtb-testExportFileSystemState,,1689459089451.18ace9a1aade05fc0f7d9e4c10da84bc.', STARTKEY => '', ENDKEY => '1'} 2023-07-15 22:11:29,932 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1689459089451.18ace9a1aade05fc0f7d9e4c10da84bc. service=AccessControlService 2023-07-15 22:11:29,932 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 22:11:29,932 INFO [StoreOpener-eb451d60f8057a5a728f1cd282375776-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region eb451d60f8057a5a728f1cd282375776 2023-07-15 22:11:29,932 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 18ace9a1aade05fc0f7d9e4c10da84bc 2023-07-15 22:11:29,932 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689459089451.18ace9a1aade05fc0f7d9e4c10da84bc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 22:11:29,933 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 18ace9a1aade05fc0f7d9e4c10da84bc 2023-07-15 22:11:29,933 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 18ace9a1aade05fc0f7d9e4c10da84bc 2023-07-15 22:11:29,934 INFO [StoreOpener-18ace9a1aade05fc0f7d9e4c10da84bc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 18ace9a1aade05fc0f7d9e4c10da84bc 2023-07-15 22:11:29,934 DEBUG [StoreOpener-eb451d60f8057a5a728f1cd282375776-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportFileSystemState/eb451d60f8057a5a728f1cd282375776/cf 2023-07-15 22:11:29,934 DEBUG [StoreOpener-eb451d60f8057a5a728f1cd282375776-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportFileSystemState/eb451d60f8057a5a728f1cd282375776/cf 2023-07-15 22:11:29,935 INFO [StoreOpener-eb451d60f8057a5a728f1cd282375776-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region eb451d60f8057a5a728f1cd282375776 columnFamilyName cf 2023-07-15 22:11:29,935 INFO [StoreOpener-eb451d60f8057a5a728f1cd282375776-1] regionserver.HStore(310): Store=eb451d60f8057a5a728f1cd282375776/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 22:11:29,936 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportFileSystemState/eb451d60f8057a5a728f1cd282375776 2023-07-15 22:11:29,938 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportFileSystemState/eb451d60f8057a5a728f1cd282375776 2023-07-15 22:11:29,939 DEBUG [StoreOpener-18ace9a1aade05fc0f7d9e4c10da84bc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportFileSystemState/18ace9a1aade05fc0f7d9e4c10da84bc/cf 2023-07-15 22:11:29,939 DEBUG [StoreOpener-18ace9a1aade05fc0f7d9e4c10da84bc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportFileSystemState/18ace9a1aade05fc0f7d9e4c10da84bc/cf 2023-07-15 22:11:29,939 INFO [StoreOpener-18ace9a1aade05fc0f7d9e4c10da84bc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 18ace9a1aade05fc0f7d9e4c10da84bc columnFamilyName cf 2023-07-15 22:11:29,940 INFO [StoreOpener-18ace9a1aade05fc0f7d9e4c10da84bc-1] regionserver.HStore(310): Store=18ace9a1aade05fc0f7d9e4c10da84bc/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 22:11:29,941 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportFileSystemState/18ace9a1aade05fc0f7d9e4c10da84bc 2023-07-15 22:11:29,942 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for eb451d60f8057a5a728f1cd282375776 2023-07-15 22:11:29,942 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportFileSystemState/18ace9a1aade05fc0f7d9e4c10da84bc 2023-07-15 22:11:29,945 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportFileSystemState/eb451d60f8057a5a728f1cd282375776/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 22:11:29,945 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened eb451d60f8057a5a728f1cd282375776; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74683398, jitterRate=0.11286935210227966}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 22:11:29,946 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for eb451d60f8057a5a728f1cd282375776: 2023-07-15 22:11:29,946 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 18ace9a1aade05fc0f7d9e4c10da84bc 2023-07-15 22:11:29,947 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1689459089451.eb451d60f8057a5a728f1cd282375776., pid=30, masterSystemTime=1689459089919 2023-07-15 22:11:29,954 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportFileSystemState/18ace9a1aade05fc0f7d9e4c10da84bc/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 22:11:29,955 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1689459089451.eb451d60f8057a5a728f1cd282375776. 2023-07-15 22:11:29,955 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 18ace9a1aade05fc0f7d9e4c10da84bc; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68258420, jitterRate=0.017129719257354736}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 22:11:29,955 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 18ace9a1aade05fc0f7d9e4c10da84bc: 2023-07-15 22:11:29,955 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1689459089451.eb451d60f8057a5a728f1cd282375776. 2023-07-15 22:11:29,956 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=eb451d60f8057a5a728f1cd282375776, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:29,956 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1689459089451.eb451d60f8057a5a728f1cd282375776.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689459089955"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689459089955"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689459089955"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689459089955"}]},"ts":"1689459089955"} 2023-07-15 22:11:29,956 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1689459089451.18ace9a1aade05fc0f7d9e4c10da84bc., pid=31, masterSystemTime=1689459089919 2023-07-15 22:11:29,961 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1689459089451.18ace9a1aade05fc0f7d9e4c10da84bc. 2023-07-15 22:11:29,962 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1689459089451.18ace9a1aade05fc0f7d9e4c10da84bc. 2023-07-15 22:11:29,963 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=18ace9a1aade05fc0f7d9e4c10da84bc, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:29,964 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1689459089451.18ace9a1aade05fc0f7d9e4c10da84bc.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689459089963"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689459089963"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689459089963"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689459089963"}]},"ts":"1689459089963"} 2023-07-15 22:11:29,968 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=29 2023-07-15 22:11:29,968 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=29, state=SUCCESS; OpenRegionProcedure eb451d60f8057a5a728f1cd282375776, server=jenkins-hbase4.apache.org,46037,1689459063224 in 195 msec 2023-07-15 22:11:29,970 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=28 2023-07-15 22:11:29,971 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=28, state=SUCCESS; OpenRegionProcedure 18ace9a1aade05fc0f7d9e4c10da84bc, server=jenkins-hbase4.apache.org,37287,1689459063311 in 200 msec 2023-07-15 22:11:29,973 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=eb451d60f8057a5a728f1cd282375776, ASSIGN in 363 msec 2023-07-15 22:11:29,979 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=27 2023-07-15 22:11:29,979 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=18ace9a1aade05fc0f7d9e4c10da84bc, ASSIGN in 369 msec 2023-07-15 22:11:29,983 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-15 22:11:29,983 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689459089983"}]},"ts":"1689459089983"} 2023-07-15 22:11:29,985 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-07-15 22:11:29,987 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-15 22:11:29,988 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-07-15 22:11:29,990 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38193] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-15 22:11:29,993 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 22:11:29,993 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 22:11:29,993 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 22:11:29,993 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 22:11:30,001 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-15 22:11:30,001 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-15 22:11:30,001 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-15 22:11:30,001 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-15 22:11:30,005 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 548 msec 2023-07-15 22:11:30,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-15 22:11:30,066 INFO [Listener at jenkins-hbase4.apache.org/46535] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-07-15 22:11:30,066 DEBUG [Listener at jenkins-hbase4.apache.org/46535] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemState get assigned. Timeout = 60000ms 2023-07-15 22:11:30,067 INFO [Listener at jenkins-hbase4.apache.org/46535] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 22:11:30,071 INFO [Listener at jenkins-hbase4.apache.org/46535] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemState assigned to meta. Checking AM states. 2023-07-15 22:11:30,071 INFO [Listener at jenkins-hbase4.apache.org/46535] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 22:11:30,071 INFO [Listener at jenkins-hbase4.apache.org/46535] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemState assigned. 2023-07-15 22:11:30,074 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-15 22:11:30,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689459090075 (current time:1689459090075). 2023-07-15 22:11:30,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 22:11:30,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] zookeeper.ReadOnlyZKClient(139): Connect 0x3d525a09 to 127.0.0.1:53678 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 22:11:30,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3901e85e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 22:11:30,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 22:11:30,100 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59870, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 22:11:30,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3d525a09 to 127.0.0.1:53678 2023-07-15 22:11:30,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 22:11:30,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] zookeeper.ReadOnlyZKClient(139): Connect 0x1eaefd5c to 127.0.0.1:53678 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 22:11:30,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@31037e92, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 22:11:30,111 DEBUG [hconnection-0x7f633f4-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 22:11:30,114 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59884, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 22:11:30,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1eaefd5c to 127.0.0.1:53678 2023-07-15 22:11:30,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 22:11:30,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-15 22:11:30,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 22:11:30,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-15 22:11:30,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-15 22:11:30,124 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-15 22:11:30,125 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689459690125 2023-07-15 22:11:30,125 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-15 22:11:30,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-15 22:11:30,126 DEBUG [Listener at jenkins-hbase4.apache.org/46535] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 22:11:30,126 DEBUG [Listener at jenkins-hbase4.apache.org/46535] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 22:11:30,127 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-15 22:11:30,127 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-15 22:11:30,129 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 5 msec 2023-07-15 22:11:30,129 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-15 22:11:30,130 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689459690130 2023-07-15 22:11:30,146 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:30,146 INFO [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-07-15 22:11:30,146 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 22:11:30,147 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-07-15 22:11:30,147 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-15 22:11:30,148 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:30,148 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:30,149 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:11:30,149 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:11:30,149 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:11:30,149 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:11:30,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:11:30,149 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:30,149 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:11:30,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:11:30,150 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:11:30,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:11:30,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:30,150 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:30,150 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:30,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:30,150 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:30,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:30,151 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:30,151 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 22:11:30,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-15 22:11:30,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:30,151 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:30,151 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:30,151 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-15 22:11:30,151 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:30,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-15 22:11:30,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-15 22:11:30,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:30,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:30,151 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-15 22:11:30,152 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 22:11:30,152 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-15 22:11:30,153 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-15 22:11:30,153 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-15 22:11:30,152 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-15 22:11:30,153 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:30,153 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38193,1689459063370' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-15 22:11:30,153 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-15 22:11:30,153 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:30,153 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 22:11:30,153 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-15 22:11:30,155 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 22:11:30,154 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-15 22:11:30,155 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-15 22:11:30,155 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-15 22:11:30,156 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46037,1689459063224' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-15 22:11:30,155 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-15 22:11:30,156 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37287,1689459063311' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-15 22:11:30,157 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:30,163 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:30,163 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:30,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:30,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:11:30,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:11:30,164 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:30,164 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:30,164 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:30,164 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:30,164 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 22:11:30,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:11:30,164 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 22:11:30,165 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:30,165 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 22:11:30,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:11:30,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:30,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:11:30,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:30,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:30,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:11:30,167 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46037,1689459063224' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-15 22:11:30,167 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@149d15f3[Count = 1] remaining members to acquire global barrier 2023-07-15 22:11:30,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:30,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:11:30,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:11:30,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:11:30,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:11:30,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:30,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:11:30,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:30,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:30,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:11:30,170 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37287,1689459063311' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-15 22:11:30,170 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@149d15f3[Count = 0] remaining members to acquire global barrier 2023-07-15 22:11:30,170 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-15 22:11:30,170 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:30,171 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:30,171 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:30,171 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:30,171 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:30,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:30,172 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:30,172 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-15 22:11:30,172 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:30,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:30,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:30,172 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-15 22:11:30,172 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:30,172 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 22:11:30,172 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 22:11:30,172 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-15 22:11:30,172 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-15 22:11:30,172 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,38193,1689459063370' in zk 2023-07-15 22:11:30,172 DEBUG [rs(jenkins-hbase4.apache.org,37287,1689459063311)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689459089451.18ace9a1aade05fc0f7d9e4c10da84bc. 2023-07-15 22:11:30,172 DEBUG [rs(jenkins-hbase4.apache.org,37287,1689459063311)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689459089451.18ace9a1aade05fc0f7d9e4c10da84bc. started... 2023-07-15 22:11:30,172 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:30,173 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 22:11:30,176 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 22:11:30,176 DEBUG [rs(jenkins-hbase4.apache.org,37287,1689459063311)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 18ace9a1aade05fc0f7d9e4c10da84bc: 2023-07-15 22:11:30,176 DEBUG [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689459089451.eb451d60f8057a5a728f1cd282375776. 2023-07-15 22:11:30,176 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-15 22:11:30,176 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 22:11:30,176 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 22:11:30,176 DEBUG [rs(jenkins-hbase4.apache.org,37287,1689459063311)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689459089451.18ace9a1aade05fc0f7d9e4c10da84bc.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:30,176 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-15 22:11:30,177 DEBUG [rs(jenkins-hbase4.apache.org,37287,1689459063311)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 22:11:30,176 DEBUG [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689459089451.eb451d60f8057a5a728f1cd282375776. started... 2023-07-15 22:11:30,177 DEBUG [rs(jenkins-hbase4.apache.org,37287,1689459063311)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-15 22:11:30,178 DEBUG [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for eb451d60f8057a5a728f1cd282375776: 2023-07-15 22:11:30,178 DEBUG [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689459089451.eb451d60f8057a5a728f1cd282375776.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:30,178 DEBUG [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 22:11:30,178 DEBUG [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-15 22:11:30,206 DEBUG [rs(jenkins-hbase4.apache.org,37287,1689459063311)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689459089451.18ace9a1aade05fc0f7d9e4c10da84bc. completed. 2023-07-15 22:11:30,206 DEBUG [rs(jenkins-hbase4.apache.org,37287,1689459063311)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689459089451.18ace9a1aade05fc0f7d9e4c10da84bc. 2023-07-15 22:11:30,206 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 22:11:30,206 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 22:11:30,206 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:30,206 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-15 22:11:30,207 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37287,1689459063311' in zk 2023-07-15 22:11:30,210 DEBUG [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689459089451.eb451d60f8057a5a728f1cd282375776. completed. 2023-07-15 22:11:30,210 DEBUG [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689459089451.eb451d60f8057a5a728f1cd282375776. 2023-07-15 22:11:30,210 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 22:11:30,211 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 22:11:30,211 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:30,211 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-15 22:11:30,211 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:30,211 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 22:11:30,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:30,211 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-15 22:11:30,211 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-15 22:11:30,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:11:30,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:11:30,212 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,46037,1689459063224' in zk 2023-07-15 22:11:30,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:11:30,214 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:30,214 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-15 22:11:30,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:11:30,214 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 22:11:30,214 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-15 22:11:30,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:30,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:11:30,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:30,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:30,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:11:30,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:30,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:11:30,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:30,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:30,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,37287,1689459063311': 2023-07-15 22:11:30,219 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37287,1689459063311' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-15 22:11:30,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:30,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:11:30,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:11:30,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:11:30,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:11:30,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:30,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:11:30,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:30,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:30,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:11:30,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:30,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:11:30,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:30,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:30,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,46037,1689459063224': 2023-07-15 22:11:30,224 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46037,1689459063224' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-15 22:11:30,224 INFO [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-07-15 22:11:30,224 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 22:11:30,224 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 22:11:30,224 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:30,224 INFO [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 22:11:30,226 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:30,226 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:30,226 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:30,226 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:30,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:30,226 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:30,226 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:11:30,226 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:30,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:30,226 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:30,226 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:11:30,226 DEBUG [Listener at jenkins-hbase4.apache.org/46535] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 22:11:30,226 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:11:30,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:30,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:30,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:11:30,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:11:30,227 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:11:30,227 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:11:30,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:11:30,227 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:11:30,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:11:30,227 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:11:30,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:11:30,228 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:30,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:11:30,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:30,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:30,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:30,228 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-15 22:11:30,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-15 22:11:30,229 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:30,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:30,229 DEBUG [Listener at jenkins-hbase4.apache.org/46535] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 22:11:30,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:11:30,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:30,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:11:30,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:30,231 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:11:30,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:30,231 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:30,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:11:30,232 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:30,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:30,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:11:30,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:30,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:30,239 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:11:30,239 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:11:30,239 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:11:30,239 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:11:30,239 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:11:30,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:11:30,239 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:11:30,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:11:30,239 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:11:30,240 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:11:30,240 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:11:30,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:11:30,240 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:30,240 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:30,240 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:30,240 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:11:30,240 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:30,240 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:30,240 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:11:30,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:11:30,240 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:11:30,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:11:30,240 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:11:30,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:11:30,240 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 22:11:30,240 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:30,241 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:30,241 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:30,241 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:30,241 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:11:30,243 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:30,243 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:30,244 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:30,275 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:30,309 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-15 22:11:30,309 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:30,310 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:30,310 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689459090125Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1689459090241 (+116 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1689459090243 (+2 ms)Writing data manifest for emptySnaptb0-testExportFileSystemState at 1689459090247 (+4 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1689459090267 (+20 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689459090309 (+42 ms) 2023-07-15 22:11:30,312 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-15 22:11:30,315 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 186 msec 2023-07-15 22:11:30,429 DEBUG [Listener at jenkins-hbase4.apache.org/46535] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 22:11:30,432 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-15 22:11:30,432 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 22:11:30,440 DEBUG [htable-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 22:11:30,446 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34508, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 22:11:30,447 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37287] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1689459089451.18ace9a1aade05fc0f7d9e4c10da84bc. with WAL disabled. Data may be lost in the event of a crash. 2023-07-15 22:11:30,447 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46037] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1689459089451.eb451d60f8057a5a728f1cd282375776. with WAL disabled. Data may be lost in the event of a crash. 2023-07-15 22:11:30,452 DEBUG [Listener at jenkins-hbase4.apache.org/46535] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-15 22:11:30,453 DEBUG [Listener at jenkins-hbase4.apache.org/46535] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689459089451.18ace9a1aade05fc0f7d9e4c10da84bc. 2023-07-15 22:11:30,454 INFO [Listener at jenkins-hbase4.apache.org/46535] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 22:11:30,468 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-15 22:11:30,468 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689459090468 (current time:1689459090468). 2023-07-15 22:11:30,468 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 22:11:30,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] zookeeper.ReadOnlyZKClient(139): Connect 0x3c01f80a to 127.0.0.1:53678 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 22:11:30,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7e51e0a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 22:11:30,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 22:11:30,479 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59818, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 22:11:30,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3c01f80a to 127.0.0.1:53678 2023-07-15 22:11:30,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 22:11:30,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] zookeeper.ReadOnlyZKClient(139): Connect 0x4511d202 to 127.0.0.1:53678 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 22:11:30,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5959e69a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 22:11:30,495 DEBUG [hconnection-0x7a07b72-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 22:11:30,498 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59820, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 22:11:30,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4511d202 to 127.0.0.1:53678 2023-07-15 22:11:30,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 22:11:30,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-15 22:11:30,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 22:11:30,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-15 22:11:30,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-15 22:11:30,513 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-15 22:11:30,515 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689459690515 2023-07-15 22:11:30,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-15 22:11:30,516 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-15 22:11:30,517 DEBUG [Listener at jenkins-hbase4.apache.org/46535] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 22:11:30,518 DEBUG [Listener at jenkins-hbase4.apache.org/46535] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 22:11:30,520 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-15 22:11:30,521 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-15 22:11:30,522 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 10 msec 2023-07-15 22:11:30,524 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-15 22:11:30,525 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689459690525 2023-07-15 22:11:30,542 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-07-15 22:11:30,542 INFO [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-07-15 22:11:30,542 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 22:11:30,543 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-07-15 22:11:30,543 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-15 22:11:30,544 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 22:11:30,544 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-15 22:11:30,545 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:11:30,545 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:11:30,546 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:11:30,546 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:11:30,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:11:30,545 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:11:30,545 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:30,546 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:11:30,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:11:30,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:11:30,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-15 22:11:30,546 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:30,546 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:30,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-15 22:11:30,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-15 22:11:30,546 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 22:11:30,547 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:30,547 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 22:11:30,547 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 22:11:30,547 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 22:11:30,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-15 22:11:30,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-15 22:11:30,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-15 22:11:30,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-15 22:11:30,547 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-15 22:11:30,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-15 22:11:30,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-15 22:11:30,547 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-15 22:11:30,547 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-15 22:11:30,548 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-15 22:11:30,548 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-15 22:11:30,548 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-15 22:11:30,548 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-15 22:11:30,548 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-15 22:11:30,548 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 22:11:30,548 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-15 22:11:30,548 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 22:11:30,548 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 22:11:30,550 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-15 22:11:30,551 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-15 22:11:30,549 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-15 22:11:30,551 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38193,1689459063370' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-15 22:11:30,551 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-15 22:11:30,551 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-15 22:11:30,552 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-15 22:11:30,552 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37287,1689459063311' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-15 22:11:30,552 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46037,1689459063224' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-15 22:11:30,554 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 22:11:30,555 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:30,555 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 22:11:30,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:30,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:11:30,556 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 22:11:30,555 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:30,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:11:30,556 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 22:11:30,556 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 22:11:30,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:11:30,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:11:30,556 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 22:11:30,556 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 22:11:30,556 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 22:11:30,556 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 22:11:30,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-15 22:11:30,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:11:30,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:30,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:30,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:11:30,558 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46037,1689459063224' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-15 22:11:30,558 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3c6ee1ac[Count = 1] remaining members to acquire global barrier 2023-07-15 22:11:30,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:30,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:11:30,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:11:30,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:11:30,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:11:30,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-15 22:11:30,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:11:30,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:30,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:30,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:11:30,560 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37287,1689459063311' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-15 22:11:30,560 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3c6ee1ac[Count = 0] remaining members to acquire global barrier 2023-07-15 22:11:30,560 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-15 22:11:30,560 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 22:11:30,561 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 22:11:30,561 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 22:11:30,561 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 22:11:30,561 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 22:11:30,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 22:11:30,561 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 22:11:30,561 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-15 22:11:30,561 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 22:11:30,561 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:30,562 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 22:11:30,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 22:11:30,562 DEBUG [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689459089451.eb451d60f8057a5a728f1cd282375776. 2023-07-15 22:11:30,562 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-15 22:11:30,562 DEBUG [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689459089451.eb451d60f8057a5a728f1cd282375776. started... 2023-07-15 22:11:30,562 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 22:11:30,562 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 22:11:30,562 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 22:11:30,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 22:11:30,562 INFO [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] regionserver.HRegion(2745): Flushing eb451d60f8057a5a728f1cd282375776 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-07-15 22:11:30,562 DEBUG [rs(jenkins-hbase4.apache.org,37287,1689459063311)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689459089451.18ace9a1aade05fc0f7d9e4c10da84bc. 2023-07-15 22:11:30,562 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:30,562 DEBUG [rs(jenkins-hbase4.apache.org,37287,1689459063311)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689459089451.18ace9a1aade05fc0f7d9e4c10da84bc. started... 2023-07-15 22:11:30,562 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-15 22:11:30,562 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-15 22:11:30,562 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 22:11:30,562 INFO [rs(jenkins-hbase4.apache.org,37287,1689459063311)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 18ace9a1aade05fc0f7d9e4c10da84bc 1/1 column families, dataSize=333 B heapSize=976 B 2023-07-15 22:11:30,562 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,38193,1689459063370' in zk 2023-07-15 22:11:30,564 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-15 22:11:30,564 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 22:11:30,564 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-15 22:11:30,580 INFO [rs(jenkins-hbase4.apache.org,37287,1689459063311)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=333 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportFileSystemState/18ace9a1aade05fc0f7d9e4c10da84bc/.tmp/cf/d52312795cec4780b9406707792a66cd 2023-07-15 22:11:30,583 INFO [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.93 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportFileSystemState/eb451d60f8057a5a728f1cd282375776/.tmp/cf/d6a4e09baf244e518149e39ae540738c 2023-07-15 22:11:30,590 DEBUG [rs(jenkins-hbase4.apache.org,37287,1689459063311)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportFileSystemState/18ace9a1aade05fc0f7d9e4c10da84bc/.tmp/cf/d52312795cec4780b9406707792a66cd as hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportFileSystemState/18ace9a1aade05fc0f7d9e4c10da84bc/cf/d52312795cec4780b9406707792a66cd 2023-07-15 22:11:30,594 DEBUG [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportFileSystemState/eb451d60f8057a5a728f1cd282375776/.tmp/cf/d6a4e09baf244e518149e39ae540738c as hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportFileSystemState/eb451d60f8057a5a728f1cd282375776/cf/d6a4e09baf244e518149e39ae540738c 2023-07-15 22:11:30,597 INFO [rs(jenkins-hbase4.apache.org,37287,1689459063311)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportFileSystemState/18ace9a1aade05fc0f7d9e4c10da84bc/cf/d52312795cec4780b9406707792a66cd, entries=5, sequenceid=6, filesize=5.2 K 2023-07-15 22:11:30,608 INFO [rs(jenkins-hbase4.apache.org,37287,1689459063311)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 18ace9a1aade05fc0f7d9e4c10da84bc in 46ms, sequenceid=6, compaction requested=false 2023-07-15 22:11:30,608 DEBUG [rs(jenkins-hbase4.apache.org,37287,1689459063311)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-15 22:11:30,609 DEBUG [rs(jenkins-hbase4.apache.org,37287,1689459063311)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 18ace9a1aade05fc0f7d9e4c10da84bc: 2023-07-15 22:11:30,609 DEBUG [rs(jenkins-hbase4.apache.org,37287,1689459063311)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689459089451.18ace9a1aade05fc0f7d9e4c10da84bc.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-15 22:11:30,609 DEBUG [rs(jenkins-hbase4.apache.org,37287,1689459063311)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 22:11:30,609 DEBUG [rs(jenkins-hbase4.apache.org,37287,1689459063311)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportFileSystemState/18ace9a1aade05fc0f7d9e4c10da84bc/cf/d52312795cec4780b9406707792a66cd] hfiles 2023-07-15 22:11:30,609 DEBUG [rs(jenkins-hbase4.apache.org,37287,1689459063311)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportFileSystemState/18ace9a1aade05fc0f7d9e4c10da84bc/cf/d52312795cec4780b9406707792a66cd for snapshot=snaptb0-testExportFileSystemState 2023-07-15 22:11:30,611 INFO [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportFileSystemState/eb451d60f8057a5a728f1cd282375776/cf/d6a4e09baf244e518149e39ae540738c, entries=45, sequenceid=6, filesize=7.9 K 2023-07-15 22:11:30,613 INFO [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for eb451d60f8057a5a728f1cd282375776 in 51ms, sequenceid=6, compaction requested=false 2023-07-15 22:11:30,614 DEBUG [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for eb451d60f8057a5a728f1cd282375776: 2023-07-15 22:11:30,614 DEBUG [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689459089451.eb451d60f8057a5a728f1cd282375776.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-15 22:11:30,614 DEBUG [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 22:11:30,615 DEBUG [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportFileSystemState/eb451d60f8057a5a728f1cd282375776/cf/d6a4e09baf244e518149e39ae540738c] hfiles 2023-07-15 22:11:30,615 DEBUG [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportFileSystemState/eb451d60f8057a5a728f1cd282375776/cf/d6a4e09baf244e518149e39ae540738c for snapshot=snaptb0-testExportFileSystemState 2023-07-15 22:11:30,619 DEBUG [Listener at jenkins-hbase4.apache.org/46535] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 22:11:30,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-15 22:11:30,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-15 22:11:30,620 DEBUG [Listener at jenkins-hbase4.apache.org/46535] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 22:11:30,620 DEBUG [rs(jenkins-hbase4.apache.org,37287,1689459063311)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689459089451.18ace9a1aade05fc0f7d9e4c10da84bc. completed. 2023-07-15 22:11:30,620 DEBUG [rs(jenkins-hbase4.apache.org,37287,1689459063311)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689459089451.18ace9a1aade05fc0f7d9e4c10da84bc. 2023-07-15 22:11:30,620 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 22:11:30,621 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 22:11:30,621 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:30,621 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-15 22:11:30,621 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37287,1689459063311' in zk 2023-07-15 22:11:30,627 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-15 22:11:30,627 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:30,627 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 22:11:30,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:30,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:11:30,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:11:30,627 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-15 22:11:30,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:11:30,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:11:30,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-15 22:11:30,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:11:30,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:30,630 DEBUG [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689459089451.eb451d60f8057a5a728f1cd282375776. completed. 2023-07-15 22:11:30,630 DEBUG [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689459089451.eb451d60f8057a5a728f1cd282375776. 2023-07-15 22:11:30,630 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 22:11:30,631 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 22:11:30,631 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:30,631 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-15 22:11:30,631 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,46037,1689459063224' in zk 2023-07-15 22:11:30,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:30,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:11:30,632 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:30,632 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-15 22:11:30,632 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 22:11:30,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-15 22:11:30,632 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-15 22:11:30,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:11:30,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:30,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:30,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,37287,1689459063311': 2023-07-15 22:11:30,635 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37287,1689459063311' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-15 22:11:30,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:30,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:11:30,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:11:30,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:11:30,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:11:30,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-15 22:11:30,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:11:30,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:30,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:30,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:11:30,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-15 22:11:30,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:11:30,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:30,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:30,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,46037,1689459063224': 2023-07-15 22:11:30,638 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46037,1689459063224' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-15 22:11:30,638 INFO [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-07-15 22:11:30,638 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 22:11:30,638 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 22:11:30,638 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-07-15 22:11:30,638 INFO [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 22:11:30,640 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 22:11:30,640 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 22:11:30,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 22:11:30,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:11:30,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:11:30,640 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 22:11:30,640 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 22:11:30,640 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:11:30,640 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 22:11:30,640 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 22:11:30,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 22:11:30,640 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:11:30,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 22:11:30,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:11:30,641 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 22:11:30,641 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:11:30,641 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:11:30,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 22:11:30,641 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:11:30,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:11:30,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-15 22:11:30,641 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:11:30,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:11:30,641 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:11:30,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:11:30,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 22:11:30,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:11:30,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 22:11:30,642 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:30,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 22:11:30,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-15 22:11:30,642 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:30,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:11:30,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:30,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:30,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:11:30,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-15 22:11:30,644 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:11:30,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:11:30,645 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:30,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:30,645 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:30,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:30,650 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:11:30,650 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:11:30,650 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:11:30,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:11:30,650 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:11:30,650 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:11:30,650 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:11:30,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:11:30,654 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:11:30,654 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:11:30,654 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:11:30,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:11:30,656 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:30,656 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-15 22:11:30,656 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:30,656 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:11:30,656 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-15 22:11:30,656 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:30,656 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 22:11:30,656 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:30,656 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:11:30,656 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 22:11:30,656 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 22:11:30,656 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 22:11:30,658 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:11:30,658 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-07-15 22:11:30,658 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-07-15 22:11:30,658 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:11:30,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:11:30,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:11:30,658 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:11:30,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:11:30,659 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-15 22:11:30,717 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-15 22:11:30,820 DEBUG [Listener at jenkins-hbase4.apache.org/46535] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 22:11:30,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-15 22:11:30,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-15 22:11:30,822 DEBUG [Listener at jenkins-hbase4.apache.org/46535] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-15 22:11:31,122 DEBUG [Listener at jenkins-hbase4.apache.org/46535] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 22:11:31,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-15 22:11:31,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-15 22:11:31,123 DEBUG [Listener at jenkins-hbase4.apache.org/46535] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-15 22:11:31,157 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-15 22:11:31,157 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-15 22:11:31,157 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-15 22:11:31,157 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689459090516Consolidate snapshot: snaptb0-testExportFileSystemState at 1689459090658 (+142 ms)Loading Region manifests for snaptb0-testExportFileSystemState at 1689459090658Writing data manifest for snaptb0-testExportFileSystemState at 1689459090664 (+6 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1689459090701 (+37 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689459091157 (+456 ms) 2023-07-15 22:11:31,161 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-15 22:11:31,167 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 643 msec 2023-07-15 22:11:31,624 DEBUG [Listener at jenkins-hbase4.apache.org/46535] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 22:11:31,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-15 22:11:31,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 22:11:31,629 INFO [Listener at jenkins-hbase4.apache.org/46535] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/export-test/export-1689459091629 2023-07-15 22:11:31,629 INFO [Listener at jenkins-hbase4.apache.org/46535] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:33847, tgtDir=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/export-test/export-1689459091629, rawTgtDir=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/export-test/export-1689459091629, srcFsUri=hdfs://localhost:33847, srcDir=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e 2023-07-15 22:11:31,658 DEBUG [Listener at jenkins-hbase4.apache.org/46535] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:33847, inputRoot=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e 2023-07-15 22:11:31,658 DEBUG [Listener at jenkins-hbase4.apache.org/46535] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1360181791_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/export-test/export-1689459091629, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/export-test/export-1689459091629/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-15 22:11:31,658 INFO [Listener at jenkins-hbase4.apache.org/46535] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:33847, inputRoot=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e, snapshotDir=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-07-15 22:11:31,671 INFO [Listener at jenkins-hbase4.apache.org/46535] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/export-test/export-1689459091629/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-15 22:11:31,698 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-15 22:11:31,699 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-15 22:11:31,699 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-15 22:11:31,700 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-15 22:11:31,700 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-15 22:11:31,700 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-15 22:11:31,700 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-15 22:11:31,770 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97e758c6-fe86-0ed9-092f-cd0594d33e04/hadoop-8720110216123845767.jar 2023-07-15 22:11:31,770 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-15 22:11:31,771 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-15 22:11:31,771 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-15 22:11:31,771 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-15 22:11:31,772 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-15 22:11:31,772 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-15 22:11:31,773 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-15 22:11:31,773 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-15 22:11:31,774 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-15 22:11:31,774 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-15 22:11:31,775 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-15 22:11:31,775 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-15 22:11:31,776 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-15 22:11:31,776 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-15 22:11:31,776 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-15 22:11:31,777 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-15 22:11:31,778 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 22:11:31,778 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 22:11:31,779 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 22:11:31,779 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 22:11:31,779 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 22:11:31,780 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 22:11:31,780 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 22:11:32,317 WARN [Listener at jenkins-hbase4.apache.org/46535] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-15 22:11:32,320 INFO [Listener at jenkins-hbase4.apache.org/46535] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-07-15 22:11:32,322 DEBUG [Listener at jenkins-hbase4.apache.org/46535] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-15 22:11:33,268 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 22:11:33,268 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 22:11:33,274 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689459070788_0001_000001 (auth:SIMPLE) 2023-07-15 22:11:34,183 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689459070788_0002_000001 (auth:SIMPLE) 2023-07-15 22:11:34,700 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-15 22:11:38,601 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689459070788_0002_000001 (auth:SIMPLE) 2023-07-15 22:11:40,856 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689459070788_0002_000001 (auth:SIMPLE) 2023-07-15 22:11:43,473 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689459070788_0002_000001 (auth:SIMPLE) 2023-07-15 22:11:44,532 INFO [Listener at jenkins-hbase4.apache.org/46535] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-15 22:11:44,533 INFO [Listener at jenkins-hbase4.apache.org/46535] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-15 22:11:44,541 INFO [Listener at jenkins-hbase4.apache.org/46535] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-07-15 22:11:44,541 INFO [Listener at jenkins-hbase4.apache.org/46535] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-15 22:11:44,542 INFO [Listener at jenkins-hbase4.apache.org/46535] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-15 22:11:44,542 DEBUG [Listener at jenkins-hbase4.apache.org/46535] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2077448059_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-15 22:11:44,542 DEBUG [Listener at jenkins-hbase4.apache.org/46535] snapshot.TestExportSnapshot(367): hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-15 22:11:44,542 DEBUG [Listener at jenkins-hbase4.apache.org/46535] snapshot.TestExportSnapshot(367): hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-15 22:11:44,542 DEBUG [Listener at jenkins-hbase4.apache.org/46535] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2077448059_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/export-test/export-1689459091629/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/export-test/export-1689459091629/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-15 22:11:44,543 DEBUG [Listener at jenkins-hbase4.apache.org/46535] snapshot.TestExportSnapshot(367): hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/export-test/export-1689459091629/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-15 22:11:44,543 DEBUG [Listener at jenkins-hbase4.apache.org/46535] snapshot.TestExportSnapshot(367): hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/export-test/export-1689459091629/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-15 22:11:44,550 INFO [Listener at jenkins-hbase4.apache.org/46535] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-07-15 22:11:44,551 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-07-15 22:11:44,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] procedure2.ProcedureExecutor(1029): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-07-15 22:11:44,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-15 22:11:44,557 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689459104557"}]},"ts":"1689459104557"} 2023-07-15 22:11:44,559 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-07-15 22:11:44,560 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-07-15 22:11:44,561 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=18ace9a1aade05fc0f7d9e4c10da84bc, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=eb451d60f8057a5a728f1cd282375776, UNASSIGN}] 2023-07-15 22:11:44,564 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=18ace9a1aade05fc0f7d9e4c10da84bc, UNASSIGN 2023-07-15 22:11:44,564 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=eb451d60f8057a5a728f1cd282375776, UNASSIGN 2023-07-15 22:11:44,565 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=18ace9a1aade05fc0f7d9e4c10da84bc, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:44,565 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689459089451.18ace9a1aade05fc0f7d9e4c10da84bc.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689459104565"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689459104565"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689459104565"}]},"ts":"1689459104565"} 2023-07-15 22:11:44,565 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=eb451d60f8057a5a728f1cd282375776, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:44,566 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689459089451.eb451d60f8057a5a728f1cd282375776.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689459104565"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689459104565"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689459104565"}]},"ts":"1689459104565"} 2023-07-15 22:11:44,567 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=37, state=RUNNABLE; CloseRegionProcedure 18ace9a1aade05fc0f7d9e4c10da84bc, server=jenkins-hbase4.apache.org,37287,1689459063311}] 2023-07-15 22:11:44,568 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=38, state=RUNNABLE; CloseRegionProcedure eb451d60f8057a5a728f1cd282375776, server=jenkins-hbase4.apache.org,46037,1689459063224}] 2023-07-15 22:11:44,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-15 22:11:44,720 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 18ace9a1aade05fc0f7d9e4c10da84bc 2023-07-15 22:11:44,720 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 18ace9a1aade05fc0f7d9e4c10da84bc, disabling compactions & flushes 2023-07-15 22:11:44,720 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689459089451.18ace9a1aade05fc0f7d9e4c10da84bc. 2023-07-15 22:11:44,720 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689459089451.18ace9a1aade05fc0f7d9e4c10da84bc. 2023-07-15 22:11:44,720 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689459089451.18ace9a1aade05fc0f7d9e4c10da84bc. after waiting 0 ms 2023-07-15 22:11:44,720 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689459089451.18ace9a1aade05fc0f7d9e4c10da84bc. 2023-07-15 22:11:44,721 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close eb451d60f8057a5a728f1cd282375776 2023-07-15 22:11:44,721 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing eb451d60f8057a5a728f1cd282375776, disabling compactions & flushes 2023-07-15 22:11:44,721 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689459089451.eb451d60f8057a5a728f1cd282375776. 2023-07-15 22:11:44,721 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689459089451.eb451d60f8057a5a728f1cd282375776. 2023-07-15 22:11:44,722 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689459089451.eb451d60f8057a5a728f1cd282375776. after waiting 0 ms 2023-07-15 22:11:44,723 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689459089451.eb451d60f8057a5a728f1cd282375776. 2023-07-15 22:11:44,730 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportFileSystemState/eb451d60f8057a5a728f1cd282375776/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 22:11:44,731 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 22:11:44,732 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689459089451.eb451d60f8057a5a728f1cd282375776. 2023-07-15 22:11:44,732 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportFileSystemState/18ace9a1aade05fc0f7d9e4c10da84bc/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 22:11:44,732 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for eb451d60f8057a5a728f1cd282375776: 2023-07-15 22:11:44,733 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 22:11:44,734 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689459089451.18ace9a1aade05fc0f7d9e4c10da84bc. 2023-07-15 22:11:44,734 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 18ace9a1aade05fc0f7d9e4c10da84bc: 2023-07-15 22:11:44,735 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed eb451d60f8057a5a728f1cd282375776 2023-07-15 22:11:44,736 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=eb451d60f8057a5a728f1cd282375776, regionState=CLOSED 2023-07-15 22:11:44,736 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689459089451.eb451d60f8057a5a728f1cd282375776.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689459104736"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689459104736"}]},"ts":"1689459104736"} 2023-07-15 22:11:44,737 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 18ace9a1aade05fc0f7d9e4c10da84bc 2023-07-15 22:11:44,739 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=18ace9a1aade05fc0f7d9e4c10da84bc, regionState=CLOSED 2023-07-15 22:11:44,739 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689459089451.18ace9a1aade05fc0f7d9e4c10da84bc.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689459104739"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689459104739"}]},"ts":"1689459104739"} 2023-07-15 22:11:44,742 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=38 2023-07-15 22:11:44,742 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=38, state=SUCCESS; CloseRegionProcedure eb451d60f8057a5a728f1cd282375776, server=jenkins-hbase4.apache.org,46037,1689459063224 in 170 msec 2023-07-15 22:11:44,744 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=eb451d60f8057a5a728f1cd282375776, UNASSIGN in 181 msec 2023-07-15 22:11:44,744 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=37 2023-07-15 22:11:44,744 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=37, state=SUCCESS; CloseRegionProcedure 18ace9a1aade05fc0f7d9e4c10da84bc, server=jenkins-hbase4.apache.org,37287,1689459063311 in 175 msec 2023-07-15 22:11:44,747 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=37, resume processing ppid=36 2023-07-15 22:11:44,747 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=18ace9a1aade05fc0f7d9e4c10da84bc, UNASSIGN in 183 msec 2023-07-15 22:11:44,748 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689459104748"}]},"ts":"1689459104748"} 2023-07-15 22:11:44,750 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-07-15 22:11:44,752 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-07-15 22:11:44,755 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 202 msec 2023-07-15 22:11:44,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-15 22:11:44,861 INFO [Listener at jenkins-hbase4.apache.org/46535] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-07-15 22:11:44,862 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-07-15 22:11:44,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] procedure2.ProcedureExecutor(1029): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-15 22:11:44,866 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-15 22:11:44,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-07-15 22:11:44,867 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-15 22:11:44,868 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38193] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-07-15 22:11:44,871 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-15 22:11:44,871 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-15 22:11:44,871 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-15 22:11:44,871 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-15 22:11:44,872 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-15 22:11:44,873 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-15 22:11:44,873 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 22:11:44,873 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testExportFileSystemState/eb451d60f8057a5a728f1cd282375776 2023-07-15 22:11:44,873 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 22:11:44,873 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 22:11:44,873 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data null 2023-07-15 22:11:44,874 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data null 2023-07-15 22:11:44,873 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testExportFileSystemState/18ace9a1aade05fc0f7d9e4c10da84bc 2023-07-15 22:11:44,874 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-15 22:11:44,874 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-15 22:11:44,874 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data null 2023-07-15 22:11:44,874 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-15 22:11:44,875 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 22:11:44,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-15 22:11:44,878 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testExportFileSystemState/eb451d60f8057a5a728f1cd282375776/cf, FileablePath, hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testExportFileSystemState/eb451d60f8057a5a728f1cd282375776/recovered.edits] 2023-07-15 22:11:44,879 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testExportFileSystemState/18ace9a1aade05fc0f7d9e4c10da84bc/cf, FileablePath, hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testExportFileSystemState/18ace9a1aade05fc0f7d9e4c10da84bc/recovered.edits] 2023-07-15 22:11:44,883 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testExportFileSystemState/eb451d60f8057a5a728f1cd282375776/cf/d6a4e09baf244e518149e39ae540738c to hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/archive/data/default/testtb-testExportFileSystemState/eb451d60f8057a5a728f1cd282375776/cf/d6a4e09baf244e518149e39ae540738c 2023-07-15 22:11:44,884 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testExportFileSystemState/18ace9a1aade05fc0f7d9e4c10da84bc/cf/d52312795cec4780b9406707792a66cd to hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/archive/data/default/testtb-testExportFileSystemState/18ace9a1aade05fc0f7d9e4c10da84bc/cf/d52312795cec4780b9406707792a66cd 2023-07-15 22:11:44,887 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testExportFileSystemState/eb451d60f8057a5a728f1cd282375776/recovered.edits/9.seqid to hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/archive/data/default/testtb-testExportFileSystemState/eb451d60f8057a5a728f1cd282375776/recovered.edits/9.seqid 2023-07-15 22:11:44,888 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testExportFileSystemState/18ace9a1aade05fc0f7d9e4c10da84bc/recovered.edits/9.seqid to hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/archive/data/default/testtb-testExportFileSystemState/18ace9a1aade05fc0f7d9e4c10da84bc/recovered.edits/9.seqid 2023-07-15 22:11:44,888 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testExportFileSystemState/eb451d60f8057a5a728f1cd282375776 2023-07-15 22:11:44,888 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testExportFileSystemState/18ace9a1aade05fc0f7d9e4c10da84bc 2023-07-15 22:11:44,888 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-15 22:11:44,891 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-15 22:11:44,894 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-07-15 22:11:44,896 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-07-15 22:11:44,898 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-15 22:11:44,898 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-07-15 22:11:44,898 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1689459089451.18ace9a1aade05fc0f7d9e4c10da84bc.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689459104898"}]},"ts":"9223372036854775807"} 2023-07-15 22:11:44,898 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1689459089451.eb451d60f8057a5a728f1cd282375776.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689459104898"}]},"ts":"9223372036854775807"} 2023-07-15 22:11:44,900 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-15 22:11:44,900 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 18ace9a1aade05fc0f7d9e4c10da84bc, NAME => 'testtb-testExportFileSystemState,,1689459089451.18ace9a1aade05fc0f7d9e4c10da84bc.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => eb451d60f8057a5a728f1cd282375776, NAME => 'testtb-testExportFileSystemState,1,1689459089451.eb451d60f8057a5a728f1cd282375776.', STARTKEY => '1', ENDKEY => ''}] 2023-07-15 22:11:44,900 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-07-15 22:11:44,900 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689459104900"}]},"ts":"9223372036854775807"} 2023-07-15 22:11:44,902 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-07-15 22:11:44,905 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-15 22:11:44,907 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 43 msec 2023-07-15 22:11:44,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-15 22:11:44,979 INFO [Listener at jenkins-hbase4.apache.org/46535] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-07-15 22:11:44,988 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-07-15 22:11:44,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-07-15 22:11:44,993 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-07-15 22:11:44,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-07-15 22:11:45,029 INFO [Listener at jenkins-hbase4.apache.org/46535] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemState Thread=767 (was 751) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2077448059_17 at /127.0.0.1:58938 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (905985230) connection to jenkins-hbase4.apache.org/172.31.14.131:46535 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (905985230) connection to jenkins-hbase4.apache.org/172.31.14.131:35291 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x57410306-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x57410306-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x57410306-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x57410306-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1382093555_1 at /127.0.0.1:48058 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1949 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1382093555_1 at /127.0.0.1:40572 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1472030899_17 at /127.0.0.1:40588 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2077448059_17 at /127.0.0.1:48094 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=920 (was 912) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=347 (was 292) - SystemLoadAverage LEAK? -, ProcessCount=183 (was 183), AvailableMemoryMB=2793 (was 2852) 2023-07-15 22:11:45,029 WARN [Listener at jenkins-hbase4.apache.org/46535] hbase.ResourceChecker(130): Thread=767 is superior to 500 2023-07-15 22:11:45,053 INFO [Listener at jenkins-hbase4.apache.org/46535] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testConsecutiveExports Thread=767, OpenFileDescriptor=920, MaxFileDescriptor=60000, SystemLoadAverage=347, ProcessCount=183, AvailableMemoryMB=2793 2023-07-15 22:11:45,053 WARN [Listener at jenkins-hbase4.apache.org/46535] hbase.ResourceChecker(130): Thread=767 is superior to 500 2023-07-15 22:11:45,055 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-15 22:11:45,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-07-15 22:11:45,060 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-07-15 22:11:45,060 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-07-15 22:11:45,061 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-15 22:11:45,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-15 22:11:45,064 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testConsecutiveExports/4d76e5292c724e2da21537e8d076528f 2023-07-15 22:11:45,065 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testConsecutiveExports/7f6d3d9236bbac3caba3912a74a7eaa1 2023-07-15 22:11:45,065 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testConsecutiveExports/4d76e5292c724e2da21537e8d076528f empty. 2023-07-15 22:11:45,065 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testConsecutiveExports/7f6d3d9236bbac3caba3912a74a7eaa1 empty. 2023-07-15 22:11:45,066 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testConsecutiveExports/4d76e5292c724e2da21537e8d076528f 2023-07-15 22:11:45,066 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testConsecutiveExports/7f6d3d9236bbac3caba3912a74a7eaa1 2023-07-15 22:11:45,066 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-15 22:11:45,085 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-07-15 22:11:45,087 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => 4d76e5292c724e2da21537e8d076528f, NAME => 'testtb-testConsecutiveExports,,1689459105055.4d76e5292c724e2da21537e8d076528f.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp 2023-07-15 22:11:45,088 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => 7f6d3d9236bbac3caba3912a74a7eaa1, NAME => 'testtb-testConsecutiveExports,1,1689459105055.7f6d3d9236bbac3caba3912a74a7eaa1.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp 2023-07-15 22:11:45,111 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689459105055.4d76e5292c724e2da21537e8d076528f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 22:11:45,112 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing 4d76e5292c724e2da21537e8d076528f, disabling compactions & flushes 2023-07-15 22:11:45,112 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689459105055.4d76e5292c724e2da21537e8d076528f. 2023-07-15 22:11:45,112 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689459105055.4d76e5292c724e2da21537e8d076528f. 2023-07-15 22:11:45,112 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689459105055.4d76e5292c724e2da21537e8d076528f. after waiting 0 ms 2023-07-15 22:11:45,112 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689459105055.4d76e5292c724e2da21537e8d076528f. 2023-07-15 22:11:45,112 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689459105055.4d76e5292c724e2da21537e8d076528f. 2023-07-15 22:11:45,112 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for 4d76e5292c724e2da21537e8d076528f: 2023-07-15 22:11:45,118 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689459105055.7f6d3d9236bbac3caba3912a74a7eaa1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 22:11:45,118 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing 7f6d3d9236bbac3caba3912a74a7eaa1, disabling compactions & flushes 2023-07-15 22:11:45,118 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689459105055.7f6d3d9236bbac3caba3912a74a7eaa1. 2023-07-15 22:11:45,118 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689459105055.7f6d3d9236bbac3caba3912a74a7eaa1. 2023-07-15 22:11:45,118 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689459105055.7f6d3d9236bbac3caba3912a74a7eaa1. after waiting 0 ms 2023-07-15 22:11:45,118 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689459105055.7f6d3d9236bbac3caba3912a74a7eaa1. 2023-07-15 22:11:45,118 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689459105055.7f6d3d9236bbac3caba3912a74a7eaa1. 2023-07-15 22:11:45,118 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for 7f6d3d9236bbac3caba3912a74a7eaa1: 2023-07-15 22:11:45,123 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-07-15 22:11:45,124 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689459105055.4d76e5292c724e2da21537e8d076528f.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689459105124"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689459105124"}]},"ts":"1689459105124"} 2023-07-15 22:11:45,124 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689459105055.7f6d3d9236bbac3caba3912a74a7eaa1.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689459105124"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689459105124"}]},"ts":"1689459105124"} 2023-07-15 22:11:45,129 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-15 22:11:45,131 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-15 22:11:45,131 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689459105131"}]},"ts":"1689459105131"} 2023-07-15 22:11:45,133 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-07-15 22:11:45,136 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-15 22:11:45,138 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-15 22:11:45,138 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-15 22:11:45,138 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-15 22:11:45,138 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-15 22:11:45,138 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=4d76e5292c724e2da21537e8d076528f, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=7f6d3d9236bbac3caba3912a74a7eaa1, ASSIGN}] 2023-07-15 22:11:45,142 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=7f6d3d9236bbac3caba3912a74a7eaa1, ASSIGN 2023-07-15 22:11:45,142 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=4d76e5292c724e2da21537e8d076528f, ASSIGN 2023-07-15 22:11:45,143 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=7f6d3d9236bbac3caba3912a74a7eaa1, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37287,1689459063311; forceNewPlan=false, retain=false 2023-07-15 22:11:45,144 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=4d76e5292c724e2da21537e8d076528f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46037,1689459063224; forceNewPlan=false, retain=false 2023-07-15 22:11:45,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-15 22:11:45,294 INFO [jenkins-hbase4:42893] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-15 22:11:45,296 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=4d76e5292c724e2da21537e8d076528f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:45,297 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689459105055.4d76e5292c724e2da21537e8d076528f.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689459105296"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689459105296"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689459105296"}]},"ts":"1689459105296"} 2023-07-15 22:11:45,297 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=7f6d3d9236bbac3caba3912a74a7eaa1, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:45,297 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689459105055.7f6d3d9236bbac3caba3912a74a7eaa1.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689459105297"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689459105297"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689459105297"}]},"ts":"1689459105297"} 2023-07-15 22:11:45,303 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=43, state=RUNNABLE; OpenRegionProcedure 4d76e5292c724e2da21537e8d076528f, server=jenkins-hbase4.apache.org,46037,1689459063224}] 2023-07-15 22:11:45,304 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=44, state=RUNNABLE; OpenRegionProcedure 7f6d3d9236bbac3caba3912a74a7eaa1, server=jenkins-hbase4.apache.org,37287,1689459063311}] 2023-07-15 22:11:45,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-15 22:11:45,459 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1689459105055.4d76e5292c724e2da21537e8d076528f. 2023-07-15 22:11:45,459 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4d76e5292c724e2da21537e8d076528f, NAME => 'testtb-testConsecutiveExports,,1689459105055.4d76e5292c724e2da21537e8d076528f.', STARTKEY => '', ENDKEY => '1'} 2023-07-15 22:11:45,460 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1689459105055.4d76e5292c724e2da21537e8d076528f. service=AccessControlService 2023-07-15 22:11:45,460 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 22:11:45,460 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1689459105055.7f6d3d9236bbac3caba3912a74a7eaa1. 2023-07-15 22:11:45,460 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 4d76e5292c724e2da21537e8d076528f 2023-07-15 22:11:45,460 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7f6d3d9236bbac3caba3912a74a7eaa1, NAME => 'testtb-testConsecutiveExports,1,1689459105055.7f6d3d9236bbac3caba3912a74a7eaa1.', STARTKEY => '1', ENDKEY => ''} 2023-07-15 22:11:45,460 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689459105055.4d76e5292c724e2da21537e8d076528f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 22:11:45,460 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 4d76e5292c724e2da21537e8d076528f 2023-07-15 22:11:45,461 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 4d76e5292c724e2da21537e8d076528f 2023-07-15 22:11:45,461 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1689459105055.7f6d3d9236bbac3caba3912a74a7eaa1. service=AccessControlService 2023-07-15 22:11:45,461 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 22:11:45,461 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 7f6d3d9236bbac3caba3912a74a7eaa1 2023-07-15 22:11:45,461 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689459105055.7f6d3d9236bbac3caba3912a74a7eaa1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 22:11:45,461 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 7f6d3d9236bbac3caba3912a74a7eaa1 2023-07-15 22:11:45,461 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 7f6d3d9236bbac3caba3912a74a7eaa1 2023-07-15 22:11:45,462 INFO [StoreOpener-4d76e5292c724e2da21537e8d076528f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 4d76e5292c724e2da21537e8d076528f 2023-07-15 22:11:45,462 INFO [StoreOpener-7f6d3d9236bbac3caba3912a74a7eaa1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 7f6d3d9236bbac3caba3912a74a7eaa1 2023-07-15 22:11:45,464 DEBUG [StoreOpener-7f6d3d9236bbac3caba3912a74a7eaa1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testConsecutiveExports/7f6d3d9236bbac3caba3912a74a7eaa1/cf 2023-07-15 22:11:45,464 DEBUG [StoreOpener-7f6d3d9236bbac3caba3912a74a7eaa1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testConsecutiveExports/7f6d3d9236bbac3caba3912a74a7eaa1/cf 2023-07-15 22:11:45,464 DEBUG [StoreOpener-4d76e5292c724e2da21537e8d076528f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testConsecutiveExports/4d76e5292c724e2da21537e8d076528f/cf 2023-07-15 22:11:45,464 DEBUG [StoreOpener-4d76e5292c724e2da21537e8d076528f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testConsecutiveExports/4d76e5292c724e2da21537e8d076528f/cf 2023-07-15 22:11:45,464 INFO [StoreOpener-4d76e5292c724e2da21537e8d076528f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4d76e5292c724e2da21537e8d076528f columnFamilyName cf 2023-07-15 22:11:45,464 INFO [StoreOpener-7f6d3d9236bbac3caba3912a74a7eaa1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7f6d3d9236bbac3caba3912a74a7eaa1 columnFamilyName cf 2023-07-15 22:11:45,465 INFO [StoreOpener-4d76e5292c724e2da21537e8d076528f-1] regionserver.HStore(310): Store=4d76e5292c724e2da21537e8d076528f/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 22:11:45,465 INFO [StoreOpener-7f6d3d9236bbac3caba3912a74a7eaa1-1] regionserver.HStore(310): Store=7f6d3d9236bbac3caba3912a74a7eaa1/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 22:11:45,466 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testConsecutiveExports/7f6d3d9236bbac3caba3912a74a7eaa1 2023-07-15 22:11:45,466 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testConsecutiveExports/4d76e5292c724e2da21537e8d076528f 2023-07-15 22:11:45,466 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testConsecutiveExports/7f6d3d9236bbac3caba3912a74a7eaa1 2023-07-15 22:11:45,467 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testConsecutiveExports/4d76e5292c724e2da21537e8d076528f 2023-07-15 22:11:45,470 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 7f6d3d9236bbac3caba3912a74a7eaa1 2023-07-15 22:11:45,472 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testConsecutiveExports/7f6d3d9236bbac3caba3912a74a7eaa1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 22:11:45,472 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 7f6d3d9236bbac3caba3912a74a7eaa1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70295261, jitterRate=0.04748101532459259}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 22:11:45,472 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 7f6d3d9236bbac3caba3912a74a7eaa1: 2023-07-15 22:11:45,474 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1689459105055.7f6d3d9236bbac3caba3912a74a7eaa1., pid=46, masterSystemTime=1689459105457 2023-07-15 22:11:45,475 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 4d76e5292c724e2da21537e8d076528f 2023-07-15 22:11:45,476 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1689459105055.7f6d3d9236bbac3caba3912a74a7eaa1. 2023-07-15 22:11:45,476 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1689459105055.7f6d3d9236bbac3caba3912a74a7eaa1. 2023-07-15 22:11:45,476 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=7f6d3d9236bbac3caba3912a74a7eaa1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:45,477 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1689459105055.7f6d3d9236bbac3caba3912a74a7eaa1.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689459105476"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689459105476"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689459105476"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689459105476"}]},"ts":"1689459105476"} 2023-07-15 22:11:45,478 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testConsecutiveExports/4d76e5292c724e2da21537e8d076528f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 22:11:45,478 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 4d76e5292c724e2da21537e8d076528f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70942048, jitterRate=0.057118892669677734}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 22:11:45,478 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 4d76e5292c724e2da21537e8d076528f: 2023-07-15 22:11:45,480 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1689459105055.4d76e5292c724e2da21537e8d076528f., pid=45, masterSystemTime=1689459105455 2023-07-15 22:11:45,482 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1689459105055.4d76e5292c724e2da21537e8d076528f. 2023-07-15 22:11:45,482 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1689459105055.4d76e5292c724e2da21537e8d076528f. 2023-07-15 22:11:45,482 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=44 2023-07-15 22:11:45,482 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=44, state=SUCCESS; OpenRegionProcedure 7f6d3d9236bbac3caba3912a74a7eaa1, server=jenkins-hbase4.apache.org,37287,1689459063311 in 175 msec 2023-07-15 22:11:45,483 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=4d76e5292c724e2da21537e8d076528f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:45,483 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1689459105055.4d76e5292c724e2da21537e8d076528f.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689459105483"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689459105483"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689459105483"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689459105483"}]},"ts":"1689459105483"} 2023-07-15 22:11:45,485 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=7f6d3d9236bbac3caba3912a74a7eaa1, ASSIGN in 344 msec 2023-07-15 22:11:45,488 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=43 2023-07-15 22:11:45,488 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=43, state=SUCCESS; OpenRegionProcedure 4d76e5292c724e2da21537e8d076528f, server=jenkins-hbase4.apache.org,46037,1689459063224 in 182 msec 2023-07-15 22:11:45,490 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=43, resume processing ppid=42 2023-07-15 22:11:45,491 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=4d76e5292c724e2da21537e8d076528f, ASSIGN in 350 msec 2023-07-15 22:11:45,491 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-15 22:11:45,491 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689459105491"}]},"ts":"1689459105491"} 2023-07-15 22:11:45,493 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-07-15 22:11:45,495 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-07-15 22:11:45,496 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-07-15 22:11:45,498 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38193] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-15 22:11:45,499 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 22:11:45,499 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 22:11:45,499 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 22:11:45,499 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 22:11:45,502 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-15 22:11:45,502 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-15 22:11:45,502 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-15 22:11:45,502 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-15 22:11:45,503 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 447 msec 2023-07-15 22:11:45,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-15 22:11:45,666 INFO [Listener at jenkins-hbase4.apache.org/46535] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-07-15 22:11:45,666 DEBUG [Listener at jenkins-hbase4.apache.org/46535] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testConsecutiveExports get assigned. Timeout = 60000ms 2023-07-15 22:11:45,666 INFO [Listener at jenkins-hbase4.apache.org/46535] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 22:11:45,669 INFO [Listener at jenkins-hbase4.apache.org/46535] hbase.HBaseTestingUtility(3484): All regions for table testtb-testConsecutiveExports assigned to meta. Checking AM states. 2023-07-15 22:11:45,670 INFO [Listener at jenkins-hbase4.apache.org/46535] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 22:11:45,670 INFO [Listener at jenkins-hbase4.apache.org/46535] hbase.HBaseTestingUtility(3504): All regions for table testtb-testConsecutiveExports assigned. 2023-07-15 22:11:45,673 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-15 22:11:45,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689459105673 (current time:1689459105673). 2023-07-15 22:11:45,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 22:11:45,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] zookeeper.ReadOnlyZKClient(139): Connect 0x5a25c979 to 127.0.0.1:53678 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 22:11:45,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1a691143, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 22:11:45,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 22:11:45,684 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59060, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 22:11:45,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5a25c979 to 127.0.0.1:53678 2023-07-15 22:11:45,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 22:11:45,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] zookeeper.ReadOnlyZKClient(139): Connect 0x4b27a255 to 127.0.0.1:53678 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 22:11:45,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3f3dd449, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 22:11:45,696 DEBUG [hconnection-0x6d0c29e4-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 22:11:45,697 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59064, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 22:11:45,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4b27a255 to 127.0.0.1:53678 2023-07-15 22:11:45,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 22:11:45,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-15 22:11:45,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 22:11:45,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-15 22:11:45,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] procedure2.ProcedureExecutor(1029): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-15 22:11:45,707 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-15 22:11:45,708 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689459705708 2023-07-15 22:11:45,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-15 22:11:45,709 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-15 22:11:45,709 DEBUG [Listener at jenkins-hbase4.apache.org/46535] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 22:11:45,709 DEBUG [Listener at jenkins-hbase4.apache.org/46535] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 22:11:45,712 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-15 22:11:45,713 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-15 22:11:45,714 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 7 msec 2023-07-15 22:11:45,715 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-15 22:11:45,716 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689459705716 2023-07-15 22:11:45,742 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:45,742 INFO [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-07-15 22:11:45,742 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 22:11:45,744 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-07-15 22:11:45,744 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-15 22:11:45,806 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:45,806 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:45,807 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:45,807 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:11:45,807 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:11:45,807 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:11:45,807 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:11:45,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:11:45,808 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:11:45,808 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:45,807 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:11:45,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:11:45,808 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:45,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:11:45,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:45,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:45,808 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:45,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:45,809 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:45,808 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 22:11:45,809 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:45,809 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:45,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-15 22:11:45,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:45,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-15 22:11:45,809 DEBUG [Listener at jenkins-hbase4.apache.org/46535] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 22:11:45,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-15 22:11:45,809 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-15 22:11:45,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:45,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:45,810 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-15 22:11:45,810 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-15 22:11:45,810 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:45,810 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:45,810 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-15 22:11:45,810 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-15 22:11:45,810 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 22:11:45,810 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 22:11:45,810 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:45,811 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-15 22:11:45,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-15 22:11:45,812 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-15 22:11:45,812 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-15 22:11:45,812 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-15 22:11:45,812 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-15 22:11:45,812 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38193,1689459063370' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-15 22:11:45,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-15 22:11:45,812 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 22:11:45,812 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46037,1689459063224' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-15 22:11:45,816 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-15 22:11:45,817 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-15 22:11:45,817 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37287,1689459063311' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-15 22:11:45,817 DEBUG [Listener at jenkins-hbase4.apache.org/46535] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 22:11:45,818 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:45,819 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:45,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:45,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:11:45,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:11:45,821 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:45,821 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:45,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:11:45,821 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:45,821 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:45,821 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 22:11:45,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:11:45,821 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:45,822 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 22:11:45,822 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:45,822 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 22:11:45,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:45,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:11:45,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:45,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:45,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:11:45,825 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37287,1689459063311' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-15 22:11:45,825 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7fa76fe9[Count = 1] remaining members to acquire global barrier 2023-07-15 22:11:45,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:45,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:11:45,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:11:45,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:11:45,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:11:45,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:45,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:11:45,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:45,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:45,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:11:45,829 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46037,1689459063224' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-15 22:11:45,829 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7fa76fe9[Count = 0] remaining members to acquire global barrier 2023-07-15 22:11:45,829 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-15 22:11:45,829 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:45,830 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:45,830 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:45,830 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:45,830 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:45,830 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:45,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:45,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:45,830 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-15 22:11:45,830 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-15 22:11:45,831 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:45,830 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-15 22:11:45,831 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,38193,1689459063370' in zk 2023-07-15 22:11:45,830 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:45,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:45,831 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-15 22:11:45,831 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 22:11:45,831 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 22:11:45,831 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 22:11:45,831 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 22:11:45,831 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:45,858 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 22:11:45,831 DEBUG [rs(jenkins-hbase4.apache.org,37287,1689459063311)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689459105055.7f6d3d9236bbac3caba3912a74a7eaa1. 2023-07-15 22:11:45,858 DEBUG [rs(jenkins-hbase4.apache.org,37287,1689459063311)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689459105055.7f6d3d9236bbac3caba3912a74a7eaa1. started... 2023-07-15 22:11:45,857 DEBUG [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689459105055.4d76e5292c724e2da21537e8d076528f. 2023-07-15 22:11:45,858 DEBUG [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689459105055.4d76e5292c724e2da21537e8d076528f. started... 2023-07-15 22:11:45,860 DEBUG [rs(jenkins-hbase4.apache.org,37287,1689459063311)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7f6d3d9236bbac3caba3912a74a7eaa1: 2023-07-15 22:11:45,860 DEBUG [rs(jenkins-hbase4.apache.org,37287,1689459063311)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689459105055.7f6d3d9236bbac3caba3912a74a7eaa1.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:45,862 DEBUG [rs(jenkins-hbase4.apache.org,37287,1689459063311)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 22:11:45,862 DEBUG [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4d76e5292c724e2da21537e8d076528f: 2023-07-15 22:11:45,862 DEBUG [rs(jenkins-hbase4.apache.org,37287,1689459063311)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-15 22:11:45,862 DEBUG [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689459105055.4d76e5292c724e2da21537e8d076528f.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:45,862 DEBUG [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 22:11:45,862 DEBUG [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-15 22:11:45,864 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-15 22:11:45,864 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 22:11:45,864 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-15 22:11:45,877 DEBUG [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689459105055.4d76e5292c724e2da21537e8d076528f. completed. 2023-07-15 22:11:45,877 DEBUG [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689459105055.4d76e5292c724e2da21537e8d076528f. 2023-07-15 22:11:45,878 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 22:11:45,878 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 22:11:45,878 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:45,878 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-15 22:11:45,878 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,46037,1689459063224' in zk 2023-07-15 22:11:45,880 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-15 22:11:45,880 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:45,880 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 22:11:45,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:45,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:11:45,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:11:45,880 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-15 22:11:45,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:11:45,882 DEBUG [rs(jenkins-hbase4.apache.org,37287,1689459063311)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689459105055.7f6d3d9236bbac3caba3912a74a7eaa1. completed. 2023-07-15 22:11:45,882 DEBUG [rs(jenkins-hbase4.apache.org,37287,1689459063311)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689459105055.7f6d3d9236bbac3caba3912a74a7eaa1. 2023-07-15 22:11:45,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:11:45,882 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 22:11:45,882 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 22:11:45,883 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:45,883 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-15 22:11:45,883 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,37287,1689459063311' in zk 2023-07-15 22:11:45,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:45,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:11:45,884 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-15 22:11:45,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:45,884 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:45,884 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 22:11:45,885 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-15 22:11:45,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:45,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:11:45,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:45,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:11:45,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:45,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:45,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,46037,1689459063224': 2023-07-15 22:11:45,888 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46037,1689459063224' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-15 22:11:45,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:45,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:11:45,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:11:45,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:11:45,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:11:45,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:45,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:11:45,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:45,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:45,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:11:45,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:45,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:11:45,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:45,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:45,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,37287,1689459063311': 2023-07-15 22:11:45,894 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37287,1689459063311' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-15 22:11:45,894 INFO [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-07-15 22:11:45,894 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 22:11:45,894 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 22:11:45,894 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:45,894 INFO [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 22:11:45,897 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:45,897 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:45,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:45,897 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:11:45,897 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:45,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:11:45,897 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:45,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:45,897 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:45,897 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:45,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:45,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:11:45,897 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:11:45,897 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:45,897 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:11:45,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:45,898 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:11:45,898 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:11:45,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:11:45,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:11:45,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:11:45,898 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:11:45,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:11:45,898 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:11:45,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:45,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:45,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:45,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:45,899 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:45,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:11:45,899 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:45,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:45,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:11:45,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:45,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:45,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:11:45,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:45,901 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:11:45,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:11:45,902 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:45,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:45,902 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:45,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:45,905 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:45,905 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:11:45,905 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:11:45,905 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:11:45,905 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:45,905 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:11:45,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:11:45,905 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:11:45,905 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:45,905 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:11:45,905 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:11:45,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:11:45,906 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:11:45,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:11:45,905 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:11:45,905 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:45,905 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 22:11:45,906 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:11:45,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:11:45,905 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:11:45,905 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:11:45,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:11:45,906 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:45,906 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:45,908 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:45,908 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:45,908 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:45,908 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:11:45,908 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:45,908 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:45,909 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:11:45,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:11:45,909 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:45,932 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:45,978 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-15 22:11:45,978 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:45,979 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-15 22:11:45,980 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689459105709Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1689459105906 (+197 ms)Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1689459105908 (+2 ms)Writing data manifest for emptySnaptb0-testConsecutiveExports at 1689459105912 (+4 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1689459105924 (+12 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689459105978 (+54 ms) 2023-07-15 22:11:45,983 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-15 22:11:45,985 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 272 msec 2023-07-15 22:11:46,017 DEBUG [Listener at jenkins-hbase4.apache.org/46535] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 22:11:46,018 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-15 22:11:46,018 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 22:11:46,027 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46037] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1689459105055.4d76e5292c724e2da21537e8d076528f. with WAL disabled. Data may be lost in the event of a crash. 2023-07-15 22:11:46,029 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37287] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1689459105055.7f6d3d9236bbac3caba3912a74a7eaa1. with WAL disabled. Data may be lost in the event of a crash. 2023-07-15 22:11:46,032 DEBUG [Listener at jenkins-hbase4.apache.org/46535] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-15 22:11:46,032 DEBUG [Listener at jenkins-hbase4.apache.org/46535] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689459105055.4d76e5292c724e2da21537e8d076528f. 2023-07-15 22:11:46,033 INFO [Listener at jenkins-hbase4.apache.org/46535] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 22:11:46,049 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-15 22:11:46,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689459106049 (current time:1689459106049). 2023-07-15 22:11:46,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 22:11:46,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] zookeeper.ReadOnlyZKClient(139): Connect 0x7a07e68b to 127.0.0.1:53678 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 22:11:46,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7d87bbd5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 22:11:46,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 22:11:46,070 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59072, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 22:11:46,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7a07e68b to 127.0.0.1:53678 2023-07-15 22:11:46,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 22:11:46,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] zookeeper.ReadOnlyZKClient(139): Connect 0x0bf738aa to 127.0.0.1:53678 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 22:11:46,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4e01a4e1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 22:11:46,097 DEBUG [hconnection-0xe98e7e7-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 22:11:46,101 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59088, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 22:11:46,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0bf738aa to 127.0.0.1:53678 2023-07-15 22:11:46,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 22:11:46,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-15 22:11:46,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 22:11:46,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-15 22:11:46,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-15 22:11:46,112 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-15 22:11:46,113 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689459706113 2023-07-15 22:11:46,113 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-15 22:11:46,113 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-15 22:11:46,114 DEBUG [Listener at jenkins-hbase4.apache.org/46535] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 22:11:46,115 DEBUG [Listener at jenkins-hbase4.apache.org/46535] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 22:11:46,122 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-15 22:11:46,123 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-15 22:11:46,124 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 13 msec 2023-07-15 22:11:46,126 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-15 22:11:46,126 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689459706126 2023-07-15 22:11:46,149 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-07-15 22:11:46,149 INFO [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-07-15 22:11:46,149 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 22:11:46,151 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-07-15 22:11:46,151 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-15 22:11:46,152 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 22:11:46,152 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-15 22:11:46,153 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:11:46,153 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:46,153 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:11:46,153 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:11:46,153 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:11:46,153 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:11:46,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:11:46,153 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:11:46,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:11:46,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:11:46,154 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:46,154 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:46,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-15 22:11:46,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-15 22:11:46,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-15 22:11:46,155 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 22:11:46,155 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 22:11:46,155 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:46,155 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 22:11:46,155 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 22:11:46,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-15 22:11:46,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-15 22:11:46,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-15 22:11:46,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-15 22:11:46,156 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-15 22:11:46,156 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-15 22:11:46,156 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-15 22:11:46,156 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-15 22:11:46,156 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-15 22:11:46,156 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 22:11:46,156 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-15 22:11:46,157 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 22:11:46,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-15 22:11:46,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-15 22:11:46,157 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-15 22:11:46,164 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-15 22:11:46,164 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-15 22:11:46,164 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-15 22:11:46,165 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-15 22:11:46,165 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38193,1689459063370' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-15 22:11:46,164 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-15 22:11:46,164 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46037,1689459063224' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-15 22:11:46,165 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-15 22:11:46,165 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 22:11:46,167 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-15 22:11:46,167 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-15 22:11:46,167 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37287,1689459063311' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-15 22:11:46,169 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 22:11:46,170 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 22:11:46,170 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:46,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:46,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:11:46,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:11:46,171 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 22:11:46,171 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:46,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:11:46,172 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 22:11:46,172 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 22:11:46,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:11:46,172 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 22:11:46,172 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 22:11:46,172 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 22:11:46,172 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 22:11:46,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-15 22:11:46,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:11:46,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:46,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:46,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:11:46,184 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46037,1689459063224' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-15 22:11:46,184 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4b42f727[Count = 1] remaining members to acquire global barrier 2023-07-15 22:11:46,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:46,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:11:46,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:11:46,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:11:46,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:11:46,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-15 22:11:46,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:11:46,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:46,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:46,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:11:46,187 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37287,1689459063311' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-15 22:11:46,187 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4b42f727[Count = 0] remaining members to acquire global barrier 2023-07-15 22:11:46,187 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-15 22:11:46,187 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 22:11:46,189 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 22:11:46,189 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 22:11:46,189 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 22:11:46,189 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 22:11:46,189 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 22:11:46,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 22:11:46,189 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 22:11:46,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 22:11:46,189 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-15 22:11:46,189 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-15 22:11:46,189 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,38193,1689459063370' in zk 2023-07-15 22:11:46,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 22:11:46,189 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-15 22:11:46,189 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-15 22:11:46,189 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:46,191 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:46,191 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 22:11:46,192 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-15 22:11:46,192 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 22:11:46,192 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-15 22:11:46,201 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 22:11:46,204 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 22:11:46,204 DEBUG [rs(jenkins-hbase4.apache.org,37287,1689459063311)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689459105055.7f6d3d9236bbac3caba3912a74a7eaa1. 2023-07-15 22:11:46,204 DEBUG [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689459105055.4d76e5292c724e2da21537e8d076528f. 2023-07-15 22:11:46,204 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 22:11:46,205 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 22:11:46,205 DEBUG [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689459105055.4d76e5292c724e2da21537e8d076528f. started... 2023-07-15 22:11:46,205 DEBUG [rs(jenkins-hbase4.apache.org,37287,1689459063311)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689459105055.7f6d3d9236bbac3caba3912a74a7eaa1. started... 2023-07-15 22:11:46,205 INFO [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 4d76e5292c724e2da21537e8d076528f 1/1 column families, dataSize=65 B heapSize=400 B 2023-07-15 22:11:46,206 INFO [rs(jenkins-hbase4.apache.org,37287,1689459063311)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 7f6d3d9236bbac3caba3912a74a7eaa1 1/1 column families, dataSize=3.19 KB heapSize=7.14 KB 2023-07-15 22:11:46,215 DEBUG [Listener at jenkins-hbase4.apache.org/46535] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 22:11:46,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-15 22:11:46,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-15 22:11:46,217 DEBUG [Listener at jenkins-hbase4.apache.org/46535] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 22:11:46,247 INFO [rs(jenkins-hbase4.apache.org,37287,1689459063311)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.19 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testConsecutiveExports/7f6d3d9236bbac3caba3912a74a7eaa1/.tmp/cf/ca0b3dec214b4f3ab20dbcb3e18bf4ac 2023-07-15 22:11:46,264 DEBUG [rs(jenkins-hbase4.apache.org,37287,1689459063311)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testConsecutiveExports/7f6d3d9236bbac3caba3912a74a7eaa1/.tmp/cf/ca0b3dec214b4f3ab20dbcb3e18bf4ac as hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testConsecutiveExports/7f6d3d9236bbac3caba3912a74a7eaa1/cf/ca0b3dec214b4f3ab20dbcb3e18bf4ac 2023-07-15 22:11:46,267 INFO [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=65 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testConsecutiveExports/4d76e5292c724e2da21537e8d076528f/.tmp/cf/69ee485acbbd4044b12efccd23ca94e3 2023-07-15 22:11:46,273 INFO [rs(jenkins-hbase4.apache.org,37287,1689459063311)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testConsecutiveExports/7f6d3d9236bbac3caba3912a74a7eaa1/cf/ca0b3dec214b4f3ab20dbcb3e18bf4ac, entries=49, sequenceid=6, filesize=8.1 K 2023-07-15 22:11:46,275 INFO [rs(jenkins-hbase4.apache.org,37287,1689459063311)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.19 KB/3271, heapSize ~7.13 KB/7296, currentSize=0 B/0 for 7f6d3d9236bbac3caba3912a74a7eaa1 in 69ms, sequenceid=6, compaction requested=false 2023-07-15 22:11:46,275 DEBUG [rs(jenkins-hbase4.apache.org,37287,1689459063311)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-15 22:11:46,276 DEBUG [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testConsecutiveExports/4d76e5292c724e2da21537e8d076528f/.tmp/cf/69ee485acbbd4044b12efccd23ca94e3 as hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testConsecutiveExports/4d76e5292c724e2da21537e8d076528f/cf/69ee485acbbd4044b12efccd23ca94e3 2023-07-15 22:11:46,276 DEBUG [rs(jenkins-hbase4.apache.org,37287,1689459063311)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7f6d3d9236bbac3caba3912a74a7eaa1: 2023-07-15 22:11:46,276 DEBUG [rs(jenkins-hbase4.apache.org,37287,1689459063311)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689459105055.7f6d3d9236bbac3caba3912a74a7eaa1.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-15 22:11:46,277 DEBUG [rs(jenkins-hbase4.apache.org,37287,1689459063311)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 22:11:46,277 DEBUG [rs(jenkins-hbase4.apache.org,37287,1689459063311)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testConsecutiveExports/7f6d3d9236bbac3caba3912a74a7eaa1/cf/ca0b3dec214b4f3ab20dbcb3e18bf4ac] hfiles 2023-07-15 22:11:46,277 DEBUG [rs(jenkins-hbase4.apache.org,37287,1689459063311)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testConsecutiveExports/7f6d3d9236bbac3caba3912a74a7eaa1/cf/ca0b3dec214b4f3ab20dbcb3e18bf4ac for snapshot=snaptb0-testConsecutiveExports 2023-07-15 22:11:46,283 INFO [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testConsecutiveExports/4d76e5292c724e2da21537e8d076528f/cf/69ee485acbbd4044b12efccd23ca94e3, entries=1, sequenceid=6, filesize=4.9 K 2023-07-15 22:11:46,284 INFO [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~65 B/65, heapSize ~384 B/384, currentSize=0 B/0 for 4d76e5292c724e2da21537e8d076528f in 79ms, sequenceid=6, compaction requested=false 2023-07-15 22:11:46,286 DEBUG [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4d76e5292c724e2da21537e8d076528f: 2023-07-15 22:11:46,286 DEBUG [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689459105055.4d76e5292c724e2da21537e8d076528f.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-15 22:11:46,286 DEBUG [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 22:11:46,286 DEBUG [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testConsecutiveExports/4d76e5292c724e2da21537e8d076528f/cf/69ee485acbbd4044b12efccd23ca94e3] hfiles 2023-07-15 22:11:46,286 DEBUG [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testConsecutiveExports/4d76e5292c724e2da21537e8d076528f/cf/69ee485acbbd4044b12efccd23ca94e3 for snapshot=snaptb0-testConsecutiveExports 2023-07-15 22:11:46,287 DEBUG [rs(jenkins-hbase4.apache.org,37287,1689459063311)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689459105055.7f6d3d9236bbac3caba3912a74a7eaa1. completed. 2023-07-15 22:11:46,287 DEBUG [rs(jenkins-hbase4.apache.org,37287,1689459063311)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689459105055.7f6d3d9236bbac3caba3912a74a7eaa1. 2023-07-15 22:11:46,287 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 22:11:46,287 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 22:11:46,287 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:46,287 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-15 22:11:46,287 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,37287,1689459063311' in zk 2023-07-15 22:11:46,289 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-15 22:11:46,289 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:46,289 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 22:11:46,289 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-15 22:11:46,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:46,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:11:46,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:11:46,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:11:46,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:11:46,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-15 22:11:46,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:11:46,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:46,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:46,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:11:46,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-15 22:11:46,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:11:46,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:46,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,37287,1689459063311': 2023-07-15 22:11:46,295 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37287,1689459063311' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-15 22:11:46,296 DEBUG [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689459105055.4d76e5292c724e2da21537e8d076528f. completed. 2023-07-15 22:11:46,296 DEBUG [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689459105055.4d76e5292c724e2da21537e8d076528f. 2023-07-15 22:11:46,296 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 22:11:46,296 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 22:11:46,296 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:46,296 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-15 22:11:46,296 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,46037,1689459063224' in zk 2023-07-15 22:11:46,297 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:46,297 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-15 22:11:46,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:46,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:11:46,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:11:46,298 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 22:11:46,298 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-15 22:11:46,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:11:46,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:11:46,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-15 22:11:46,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:11:46,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:46,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:46,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:11:46,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-15 22:11:46,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:11:46,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:46,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:46,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,46037,1689459063224': 2023-07-15 22:11:46,302 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46037,1689459063224' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-15 22:11:46,302 INFO [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-07-15 22:11:46,302 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 22:11:46,302 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 22:11:46,302 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-07-15 22:11:46,302 INFO [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 22:11:46,305 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 22:11:46,305 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 22:11:46,305 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 22:11:46,305 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:11:46,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 22:11:46,305 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 22:11:46,305 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:11:46,305 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 22:11:46,305 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 22:11:46,305 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 22:11:46,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 22:11:46,305 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:11:46,305 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:11:46,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:11:46,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 22:11:46,306 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:11:46,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:11:46,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:11:46,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 22:11:46,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 22:11:46,306 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:11:46,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:11:46,306 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:46,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:11:46,306 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:11:46,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:11:46,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 22:11:46,307 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:46,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-15 22:11:46,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 22:11:46,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:11:46,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-15 22:11:46,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:11:46,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:46,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:46,309 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:11:46,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:11:46,309 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:46,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-15 22:11:46,310 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:46,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:11:46,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:46,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:46,316 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:11:46,316 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:11:46,316 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:11:46,316 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:11:46,316 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:11:46,316 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:11:46,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:11:46,316 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:11:46,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:11:46,316 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:46,316 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:11:46,316 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:11:46,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:11:46,317 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-07-15 22:11:46,316 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-15 22:11:46,317 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-07-15 22:11:46,317 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:11:46,317 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:11:46,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:11:46,317 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 22:11:46,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:11:46,317 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:46,319 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:11:46,319 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-15 22:11:46,319 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:11:46,319 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 22:11:46,319 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:11:46,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:11:46,319 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:11:46,319 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:11:46,319 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 22:11:46,319 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 22:11:46,319 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-15 22:11:46,349 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-15 22:11:46,382 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-15 22:11:46,383 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-15 22:11:46,383 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-15 22:11:46,383 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689459106114Consolidate snapshot: snaptb0-testConsecutiveExports at 1689459106317 (+203 ms)Loading Region manifests for snaptb0-testConsecutiveExports at 1689459106317Writing data manifest for snaptb0-testConsecutiveExports at 1689459106323 (+6 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1689459106335 (+12 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689459106382 (+47 ms) 2023-07-15 22:11:46,388 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-15 22:11:46,390 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 273 msec 2023-07-15 22:11:46,417 DEBUG [Listener at jenkins-hbase4.apache.org/46535] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 22:11:46,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-15 22:11:46,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 22:11:46,419 INFO [Listener at jenkins-hbase4.apache.org/46535] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97e758c6-fe86-0ed9-092f-cd0594d33e04/local-export-1689459106419 2023-07-15 22:11:46,419 INFO [Listener at jenkins-hbase4.apache.org/46535] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97e758c6-fe86-0ed9-092f-cd0594d33e04/local-export-1689459106419, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97e758c6-fe86-0ed9-092f-cd0594d33e04/local-export-1689459106419, srcFsUri=hdfs://localhost:33847, srcDir=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e 2023-07-15 22:11:46,453 DEBUG [Listener at jenkins-hbase4.apache.org/46535] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:33847, inputRoot=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e 2023-07-15 22:11:46,453 DEBUG [Listener at jenkins-hbase4.apache.org/46535] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@16d419c4, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97e758c6-fe86-0ed9-092f-cd0594d33e04/local-export-1689459106419, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97e758c6-fe86-0ed9-092f-cd0594d33e04/local-export-1689459106419/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-15 22:11:46,453 INFO [Listener at jenkins-hbase4.apache.org/46535] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:33847, inputRoot=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e, snapshotDir=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-15 22:11:46,470 INFO [Listener at jenkins-hbase4.apache.org/46535] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97e758c6-fe86-0ed9-092f-cd0594d33e04/local-export-1689459106419/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-15 22:11:46,491 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-15 22:11:46,492 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-15 22:11:46,492 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-15 22:11:46,493 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-15 22:11:46,493 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-15 22:11:46,493 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-15 22:11:46,494 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-15 22:11:46,575 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97e758c6-fe86-0ed9-092f-cd0594d33e04/hadoop-659248806321056670.jar 2023-07-15 22:11:46,575 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-15 22:11:46,576 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-15 22:11:46,576 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-15 22:11:46,576 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-15 22:11:46,577 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-15 22:11:46,577 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-15 22:11:46,577 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-15 22:11:46,578 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-15 22:11:46,578 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-15 22:11:46,579 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-15 22:11:46,579 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-15 22:11:46,579 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-15 22:11:46,580 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-15 22:11:46,580 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-15 22:11:46,580 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-15 22:11:46,581 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-15 22:11:46,581 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 22:11:46,582 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 22:11:46,582 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 22:11:46,582 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 22:11:46,582 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 22:11:46,583 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 22:11:46,583 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 22:11:46,942 WARN [Listener at jenkins-hbase4.apache.org/46535] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-15 22:11:46,945 INFO [Listener at jenkins-hbase4.apache.org/46535] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-15 22:11:46,948 DEBUG [Listener at jenkins-hbase4.apache.org/46535] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-15 22:11:49,674 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 22:11:49,674 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 22:11:49,685 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689459070788_0002_000001 (auth:SIMPLE) 2023-07-15 22:11:50,278 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689459070788_0003_000001 (auth:SIMPLE) 2023-07-15 22:11:50,321 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-15 22:11:54,190 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689459070788_0003_000001 (auth:SIMPLE) 2023-07-15 22:11:56,417 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689459070788_0003_000001 (auth:SIMPLE) 2023-07-15 22:11:59,175 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689459070788_0003_000001 (auth:SIMPLE) 2023-07-15 22:12:01,173 INFO [Listener at jenkins-hbase4.apache.org/46535] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-15 22:12:01,174 INFO [Listener at jenkins-hbase4.apache.org/46535] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-15 22:12:01,183 INFO [Listener at jenkins-hbase4.apache.org/46535] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-15 22:12:01,183 INFO [Listener at jenkins-hbase4.apache.org/46535] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-15 22:12:01,184 INFO [Listener at jenkins-hbase4.apache.org/46535] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-15 22:12:01,184 DEBUG [Listener at jenkins-hbase4.apache.org/46535] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2077448059_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-15 22:12:01,187 DEBUG [Listener at jenkins-hbase4.apache.org/46535] snapshot.TestExportSnapshot(367): hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-15 22:12:01,187 DEBUG [Listener at jenkins-hbase4.apache.org/46535] snapshot.TestExportSnapshot(367): hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-15 22:12:01,187 DEBUG [Listener at jenkins-hbase4.apache.org/46535] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@73cb3a8e in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97e758c6-fe86-0ed9-092f-cd0594d33e04/local-export-1689459106419/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97e758c6-fe86-0ed9-092f-cd0594d33e04/local-export-1689459106419/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-15 22:12:01,188 DEBUG [Listener at jenkins-hbase4.apache.org/46535] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97e758c6-fe86-0ed9-092f-cd0594d33e04/local-export-1689459106419/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-15 22:12:01,188 DEBUG [Listener at jenkins-hbase4.apache.org/46535] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97e758c6-fe86-0ed9-092f-cd0594d33e04/local-export-1689459106419/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-15 22:12:01,190 INFO [Listener at jenkins-hbase4.apache.org/46535] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97e758c6-fe86-0ed9-092f-cd0594d33e04/local-export-1689459106419, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97e758c6-fe86-0ed9-092f-cd0594d33e04/local-export-1689459106419, srcFsUri=hdfs://localhost:33847, srcDir=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e 2023-07-15 22:12:01,215 DEBUG [Listener at jenkins-hbase4.apache.org/46535] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:33847, inputRoot=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e 2023-07-15 22:12:01,215 DEBUG [Listener at jenkins-hbase4.apache.org/46535] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@4a37d4ee, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97e758c6-fe86-0ed9-092f-cd0594d33e04/local-export-1689459106419, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97e758c6-fe86-0ed9-092f-cd0594d33e04/local-export-1689459106419/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-15 22:12:01,215 INFO [Listener at jenkins-hbase4.apache.org/46535] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:33847, inputRoot=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e, snapshotDir=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-15 22:12:01,232 INFO [Listener at jenkins-hbase4.apache.org/46535] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97e758c6-fe86-0ed9-092f-cd0594d33e04/local-export-1689459106419/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-15 22:12:01,251 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-15 22:12:01,251 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-15 22:12:01,252 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-15 22:12:01,252 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-15 22:12:01,253 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-15 22:12:01,253 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-15 22:12:01,253 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-15 22:12:01,326 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97e758c6-fe86-0ed9-092f-cd0594d33e04/hadoop-1583056583808647280.jar 2023-07-15 22:12:01,327 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-15 22:12:01,327 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-15 22:12:01,328 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-15 22:12:01,328 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-15 22:12:01,328 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-15 22:12:01,329 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-15 22:12:01,329 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-15 22:12:01,329 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-15 22:12:01,330 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-15 22:12:01,330 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-15 22:12:01,330 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-15 22:12:01,331 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-15 22:12:01,331 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-15 22:12:01,331 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-15 22:12:01,332 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-15 22:12:01,332 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-15 22:12:01,333 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 22:12:01,333 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 22:12:01,333 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 22:12:01,334 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 22:12:01,334 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 22:12:01,334 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 22:12:01,335 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 22:12:01,897 WARN [Listener at jenkins-hbase4.apache.org/46535] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-15 22:12:01,900 INFO [Listener at jenkins-hbase4.apache.org/46535] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-15 22:12:01,902 DEBUG [Listener at jenkins-hbase4.apache.org/46535] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-15 22:12:05,346 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 22:12:05,346 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 22:12:05,349 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689459070788_0003_000001 (auth:SIMPLE) 2023-07-15 22:12:05,687 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689459070788_0004_000001 (auth:SIMPLE) 2023-07-15 22:12:09,357 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689459070788_0004_000001 (auth:SIMPLE) 2023-07-15 22:12:11,605 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689459070788_0004_000001 (auth:SIMPLE) 2023-07-15 22:12:14,571 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689459070788_0004_000001 (auth:SIMPLE) 2023-07-15 22:12:16,115 INFO [Listener at jenkins-hbase4.apache.org/46535] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-15 22:12:16,115 INFO [Listener at jenkins-hbase4.apache.org/46535] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-15 22:12:16,119 INFO [Listener at jenkins-hbase4.apache.org/46535] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-15 22:12:16,120 INFO [Listener at jenkins-hbase4.apache.org/46535] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-15 22:12:16,120 INFO [Listener at jenkins-hbase4.apache.org/46535] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-15 22:12:16,120 DEBUG [Listener at jenkins-hbase4.apache.org/46535] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2077448059_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-15 22:12:16,124 DEBUG [Listener at jenkins-hbase4.apache.org/46535] snapshot.TestExportSnapshot(367): hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-15 22:12:16,124 DEBUG [Listener at jenkins-hbase4.apache.org/46535] snapshot.TestExportSnapshot(367): hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-15 22:12:16,124 DEBUG [Listener at jenkins-hbase4.apache.org/46535] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@73cb3a8e in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97e758c6-fe86-0ed9-092f-cd0594d33e04/local-export-1689459106419/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97e758c6-fe86-0ed9-092f-cd0594d33e04/local-export-1689459106419/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-15 22:12:16,125 DEBUG [Listener at jenkins-hbase4.apache.org/46535] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97e758c6-fe86-0ed9-092f-cd0594d33e04/local-export-1689459106419/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-15 22:12:16,125 DEBUG [Listener at jenkins-hbase4.apache.org/46535] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97e758c6-fe86-0ed9-092f-cd0594d33e04/local-export-1689459106419/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-15 22:12:16,143 INFO [Listener at jenkins-hbase4.apache.org/46535] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-07-15 22:12:16,143 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-07-15 22:12:16,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] procedure2.ProcedureExecutor(1029): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-07-15 22:12:16,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-15 22:12:16,149 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689459136149"}]},"ts":"1689459136149"} 2023-07-15 22:12:16,151 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-07-15 22:12:16,153 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-07-15 22:12:16,154 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=4d76e5292c724e2da21537e8d076528f, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=7f6d3d9236bbac3caba3912a74a7eaa1, UNASSIGN}] 2023-07-15 22:12:16,156 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=4d76e5292c724e2da21537e8d076528f, UNASSIGN 2023-07-15 22:12:16,156 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=7f6d3d9236bbac3caba3912a74a7eaa1, UNASSIGN 2023-07-15 22:12:16,157 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=4d76e5292c724e2da21537e8d076528f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:16,157 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=7f6d3d9236bbac3caba3912a74a7eaa1, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:16,157 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689459105055.4d76e5292c724e2da21537e8d076528f.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689459136157"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689459136157"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689459136157"}]},"ts":"1689459136157"} 2023-07-15 22:12:16,157 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689459105055.7f6d3d9236bbac3caba3912a74a7eaa1.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689459136157"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689459136157"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689459136157"}]},"ts":"1689459136157"} 2023-07-15 22:12:16,159 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=52, state=RUNNABLE; CloseRegionProcedure 4d76e5292c724e2da21537e8d076528f, server=jenkins-hbase4.apache.org,46037,1689459063224}] 2023-07-15 22:12:16,160 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=53, state=RUNNABLE; CloseRegionProcedure 7f6d3d9236bbac3caba3912a74a7eaa1, server=jenkins-hbase4.apache.org,37287,1689459063311}] 2023-07-15 22:12:16,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-15 22:12:16,312 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 4d76e5292c724e2da21537e8d076528f 2023-07-15 22:12:16,312 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 7f6d3d9236bbac3caba3912a74a7eaa1 2023-07-15 22:12:16,312 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 4d76e5292c724e2da21537e8d076528f, disabling compactions & flushes 2023-07-15 22:12:16,312 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 7f6d3d9236bbac3caba3912a74a7eaa1, disabling compactions & flushes 2023-07-15 22:12:16,312 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689459105055.4d76e5292c724e2da21537e8d076528f. 2023-07-15 22:12:16,312 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689459105055.7f6d3d9236bbac3caba3912a74a7eaa1. 2023-07-15 22:12:16,312 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689459105055.4d76e5292c724e2da21537e8d076528f. 2023-07-15 22:12:16,312 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689459105055.7f6d3d9236bbac3caba3912a74a7eaa1. 2023-07-15 22:12:16,312 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689459105055.4d76e5292c724e2da21537e8d076528f. after waiting 0 ms 2023-07-15 22:12:16,312 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689459105055.4d76e5292c724e2da21537e8d076528f. 2023-07-15 22:12:16,312 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689459105055.7f6d3d9236bbac3caba3912a74a7eaa1. after waiting 0 ms 2023-07-15 22:12:16,312 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689459105055.7f6d3d9236bbac3caba3912a74a7eaa1. 2023-07-15 22:12:16,327 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testConsecutiveExports/7f6d3d9236bbac3caba3912a74a7eaa1/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 22:12:16,328 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 22:12:16,328 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testConsecutiveExports/4d76e5292c724e2da21537e8d076528f/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 22:12:16,329 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689459105055.7f6d3d9236bbac3caba3912a74a7eaa1. 2023-07-15 22:12:16,330 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 7f6d3d9236bbac3caba3912a74a7eaa1: 2023-07-15 22:12:16,331 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 7f6d3d9236bbac3caba3912a74a7eaa1 2023-07-15 22:12:16,333 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=7f6d3d9236bbac3caba3912a74a7eaa1, regionState=CLOSED 2023-07-15 22:12:16,334 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689459105055.7f6d3d9236bbac3caba3912a74a7eaa1.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689459136333"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689459136333"}]},"ts":"1689459136333"} 2023-07-15 22:12:16,335 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 22:12:16,336 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689459105055.4d76e5292c724e2da21537e8d076528f. 2023-07-15 22:12:16,336 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 4d76e5292c724e2da21537e8d076528f: 2023-07-15 22:12:16,338 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 4d76e5292c724e2da21537e8d076528f 2023-07-15 22:12:16,339 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=4d76e5292c724e2da21537e8d076528f, regionState=CLOSED 2023-07-15 22:12:16,339 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689459105055.4d76e5292c724e2da21537e8d076528f.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689459136339"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689459136339"}]},"ts":"1689459136339"} 2023-07-15 22:12:16,341 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=53 2023-07-15 22:12:16,341 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=53, state=SUCCESS; CloseRegionProcedure 7f6d3d9236bbac3caba3912a74a7eaa1, server=jenkins-hbase4.apache.org,37287,1689459063311 in 178 msec 2023-07-15 22:12:16,345 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=7f6d3d9236bbac3caba3912a74a7eaa1, UNASSIGN in 187 msec 2023-07-15 22:12:16,345 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=52 2023-07-15 22:12:16,345 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=52, state=SUCCESS; CloseRegionProcedure 4d76e5292c724e2da21537e8d076528f, server=jenkins-hbase4.apache.org,46037,1689459063224 in 182 msec 2023-07-15 22:12:16,347 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=51 2023-07-15 22:12:16,347 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=4d76e5292c724e2da21537e8d076528f, UNASSIGN in 191 msec 2023-07-15 22:12:16,348 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689459136348"}]},"ts":"1689459136348"} 2023-07-15 22:12:16,349 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-07-15 22:12:16,351 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-07-15 22:12:16,353 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 208 msec 2023-07-15 22:12:16,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-15 22:12:16,452 INFO [Listener at jenkins-hbase4.apache.org/46535] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-07-15 22:12:16,453 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-07-15 22:12:16,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] procedure2.ProcedureExecutor(1029): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-15 22:12:16,457 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-15 22:12:16,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-07-15 22:12:16,458 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-15 22:12:16,461 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38193] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-07-15 22:12:16,464 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-15 22:12:16,464 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-15 22:12:16,464 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-15 22:12:16,464 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-15 22:12:16,465 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-15 22:12:16,465 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-15 22:12:16,465 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-15 22:12:16,465 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-15 22:12:16,465 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testConsecutiveExports/4d76e5292c724e2da21537e8d076528f 2023-07-15 22:12:16,465 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testConsecutiveExports/7f6d3d9236bbac3caba3912a74a7eaa1 2023-07-15 22:12:16,466 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-15 22:12:16,466 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-15 22:12:16,466 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 22:12:16,466 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 22:12:16,466 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-15 22:12:16,466 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 22:12:16,466 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-15 22:12:16,466 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 22:12:16,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-15 22:12:16,468 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testConsecutiveExports/7f6d3d9236bbac3caba3912a74a7eaa1/cf, FileablePath, hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testConsecutiveExports/7f6d3d9236bbac3caba3912a74a7eaa1/recovered.edits] 2023-07-15 22:12:16,468 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testConsecutiveExports/4d76e5292c724e2da21537e8d076528f/cf, FileablePath, hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testConsecutiveExports/4d76e5292c724e2da21537e8d076528f/recovered.edits] 2023-07-15 22:12:16,474 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testConsecutiveExports/7f6d3d9236bbac3caba3912a74a7eaa1/cf/ca0b3dec214b4f3ab20dbcb3e18bf4ac to hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/archive/data/default/testtb-testConsecutiveExports/7f6d3d9236bbac3caba3912a74a7eaa1/cf/ca0b3dec214b4f3ab20dbcb3e18bf4ac 2023-07-15 22:12:16,474 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testConsecutiveExports/4d76e5292c724e2da21537e8d076528f/cf/69ee485acbbd4044b12efccd23ca94e3 to hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/archive/data/default/testtb-testConsecutiveExports/4d76e5292c724e2da21537e8d076528f/cf/69ee485acbbd4044b12efccd23ca94e3 2023-07-15 22:12:16,478 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testConsecutiveExports/7f6d3d9236bbac3caba3912a74a7eaa1/recovered.edits/9.seqid to hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/archive/data/default/testtb-testConsecutiveExports/7f6d3d9236bbac3caba3912a74a7eaa1/recovered.edits/9.seqid 2023-07-15 22:12:16,478 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testConsecutiveExports/4d76e5292c724e2da21537e8d076528f/recovered.edits/9.seqid to hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/archive/data/default/testtb-testConsecutiveExports/4d76e5292c724e2da21537e8d076528f/recovered.edits/9.seqid 2023-07-15 22:12:16,478 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testConsecutiveExports/7f6d3d9236bbac3caba3912a74a7eaa1 2023-07-15 22:12:16,482 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testConsecutiveExports/4d76e5292c724e2da21537e8d076528f 2023-07-15 22:12:16,483 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-15 22:12:16,485 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-15 22:12:16,502 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-07-15 22:12:16,506 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-07-15 22:12:16,508 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-15 22:12:16,508 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-07-15 22:12:16,508 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1689459105055.4d76e5292c724e2da21537e8d076528f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689459136508"}]},"ts":"9223372036854775807"} 2023-07-15 22:12:16,508 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1689459105055.7f6d3d9236bbac3caba3912a74a7eaa1.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689459136508"}]},"ts":"9223372036854775807"} 2023-07-15 22:12:16,512 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-15 22:12:16,512 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 4d76e5292c724e2da21537e8d076528f, NAME => 'testtb-testConsecutiveExports,,1689459105055.4d76e5292c724e2da21537e8d076528f.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 7f6d3d9236bbac3caba3912a74a7eaa1, NAME => 'testtb-testConsecutiveExports,1,1689459105055.7f6d3d9236bbac3caba3912a74a7eaa1.', STARTKEY => '1', ENDKEY => ''}] 2023-07-15 22:12:16,512 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-07-15 22:12:16,512 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689459136512"}]},"ts":"9223372036854775807"} 2023-07-15 22:12:16,516 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-07-15 22:12:16,521 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-15 22:12:16,523 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 68 msec 2023-07-15 22:12:16,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-15 22:12:16,569 INFO [Listener at jenkins-hbase4.apache.org/46535] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-07-15 22:12:16,578 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-07-15 22:12:16,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-07-15 22:12:16,583 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-07-15 22:12:16,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-07-15 22:12:16,614 INFO [Listener at jenkins-hbase4.apache.org/46535] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testConsecutiveExports Thread=747 (was 767), OpenFileDescriptor=898 (was 920), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=342 (was 347), ProcessCount=181 (was 183), AvailableMemoryMB=3575 (was 2793) - AvailableMemoryMB LEAK? - 2023-07-15 22:12:16,615 WARN [Listener at jenkins-hbase4.apache.org/46535] hbase.ResourceChecker(130): Thread=747 is superior to 500 2023-07-15 22:12:16,637 INFO [Listener at jenkins-hbase4.apache.org/46535] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=747, OpenFileDescriptor=898, MaxFileDescriptor=60000, SystemLoadAverage=342, ProcessCount=181, AvailableMemoryMB=3574 2023-07-15 22:12:16,637 WARN [Listener at jenkins-hbase4.apache.org/46535] hbase.ResourceChecker(130): Thread=747 is superior to 500 2023-07-15 22:12:16,638 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-15 22:12:16,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] procedure2.ProcedureExecutor(1029): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:16,642 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-07-15 22:12:16,642 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-07-15 22:12:16,642 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-15 22:12:16,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-15 22:12:16,645 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/04cd49c752c2756f78caadf55b5e204a 2023-07-15 22:12:16,645 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/2cfccaac24cf77c10b1b760a248c053c 2023-07-15 22:12:16,646 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/04cd49c752c2756f78caadf55b5e204a empty. 2023-07-15 22:12:16,646 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/2cfccaac24cf77c10b1b760a248c053c empty. 2023-07-15 22:12:16,646 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/04cd49c752c2756f78caadf55b5e204a 2023-07-15 22:12:16,646 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/2cfccaac24cf77c10b1b760a248c053c 2023-07-15 22:12:16,646 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-15 22:12:16,665 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-07-15 22:12:16,666 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => 04cd49c752c2756f78caadf55b5e204a, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689459136638.04cd49c752c2756f78caadf55b5e204a.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp 2023-07-15 22:12:16,667 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 2cfccaac24cf77c10b1b760a248c053c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689459136638.2cfccaac24cf77c10b1b760a248c053c.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp 2023-07-15 22:12:16,679 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689459136638.04cd49c752c2756f78caadf55b5e204a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 22:12:16,679 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing 04cd49c752c2756f78caadf55b5e204a, disabling compactions & flushes 2023-07-15 22:12:16,679 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689459136638.04cd49c752c2756f78caadf55b5e204a. 2023-07-15 22:12:16,679 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689459136638.04cd49c752c2756f78caadf55b5e204a. 2023-07-15 22:12:16,679 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689459136638.04cd49c752c2756f78caadf55b5e204a. after waiting 0 ms 2023-07-15 22:12:16,679 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689459136638.04cd49c752c2756f78caadf55b5e204a. 2023-07-15 22:12:16,679 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689459136638.04cd49c752c2756f78caadf55b5e204a. 2023-07-15 22:12:16,679 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for 04cd49c752c2756f78caadf55b5e204a: 2023-07-15 22:12:16,681 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689459136638.2cfccaac24cf77c10b1b760a248c053c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 22:12:16,681 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 2cfccaac24cf77c10b1b760a248c053c, disabling compactions & flushes 2023-07-15 22:12:16,681 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689459136638.2cfccaac24cf77c10b1b760a248c053c. 2023-07-15 22:12:16,681 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689459136638.2cfccaac24cf77c10b1b760a248c053c. 2023-07-15 22:12:16,681 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689459136638.2cfccaac24cf77c10b1b760a248c053c. after waiting 0 ms 2023-07-15 22:12:16,681 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689459136638.2cfccaac24cf77c10b1b760a248c053c. 2023-07-15 22:12:16,681 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689459136638.2cfccaac24cf77c10b1b760a248c053c. 2023-07-15 22:12:16,681 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 2cfccaac24cf77c10b1b760a248c053c: 2023-07-15 22:12:16,684 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-07-15 22:12:16,685 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689459136638.04cd49c752c2756f78caadf55b5e204a.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689459136685"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689459136685"}]},"ts":"1689459136685"} 2023-07-15 22:12:16,685 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689459136638.2cfccaac24cf77c10b1b760a248c053c.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689459136685"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689459136685"}]},"ts":"1689459136685"} 2023-07-15 22:12:16,691 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-15 22:12:16,692 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-15 22:12:16,692 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689459136692"}]},"ts":"1689459136692"} 2023-07-15 22:12:16,693 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-07-15 22:12:16,697 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-15 22:12:16,698 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-15 22:12:16,698 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-15 22:12:16,698 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-15 22:12:16,698 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-15 22:12:16,699 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=04cd49c752c2756f78caadf55b5e204a, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=2cfccaac24cf77c10b1b760a248c053c, ASSIGN}] 2023-07-15 22:12:16,701 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=04cd49c752c2756f78caadf55b5e204a, ASSIGN 2023-07-15 22:12:16,701 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=2cfccaac24cf77c10b1b760a248c053c, ASSIGN 2023-07-15 22:12:16,702 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=04cd49c752c2756f78caadf55b5e204a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46037,1689459063224; forceNewPlan=false, retain=false 2023-07-15 22:12:16,702 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=2cfccaac24cf77c10b1b760a248c053c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37287,1689459063311; forceNewPlan=false, retain=false 2023-07-15 22:12:16,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-15 22:12:16,853 INFO [jenkins-hbase4:42893] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-15 22:12:16,856 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=2cfccaac24cf77c10b1b760a248c053c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:16,856 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=04cd49c752c2756f78caadf55b5e204a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:16,856 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689459136638.2cfccaac24cf77c10b1b760a248c053c.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689459136856"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689459136856"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689459136856"}]},"ts":"1689459136856"} 2023-07-15 22:12:16,856 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689459136638.04cd49c752c2756f78caadf55b5e204a.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689459136856"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689459136856"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689459136856"}]},"ts":"1689459136856"} 2023-07-15 22:12:16,859 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE; OpenRegionProcedure 2cfccaac24cf77c10b1b760a248c053c, server=jenkins-hbase4.apache.org,37287,1689459063311}] 2023-07-15 22:12:16,863 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=58, state=RUNNABLE; OpenRegionProcedure 04cd49c752c2756f78caadf55b5e204a, server=jenkins-hbase4.apache.org,46037,1689459063224}] 2023-07-15 22:12:16,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-15 22:12:17,016 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1689459136638.2cfccaac24cf77c10b1b760a248c053c. 2023-07-15 22:12:17,016 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2cfccaac24cf77c10b1b760a248c053c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689459136638.2cfccaac24cf77c10b1b760a248c053c.', STARTKEY => '1', ENDKEY => ''} 2023-07-15 22:12:17,016 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1689459136638.2cfccaac24cf77c10b1b760a248c053c. service=AccessControlService 2023-07-15 22:12:17,017 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 22:12:17,017 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 2cfccaac24cf77c10b1b760a248c053c 2023-07-15 22:12:17,017 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689459136638.2cfccaac24cf77c10b1b760a248c053c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 22:12:17,017 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 2cfccaac24cf77c10b1b760a248c053c 2023-07-15 22:12:17,017 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 2cfccaac24cf77c10b1b760a248c053c 2023-07-15 22:12:17,019 INFO [StoreOpener-2cfccaac24cf77c10b1b760a248c053c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 2cfccaac24cf77c10b1b760a248c053c 2023-07-15 22:12:17,021 DEBUG [StoreOpener-2cfccaac24cf77c10b1b760a248c053c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportFileSystemStateWithMergeRegion/2cfccaac24cf77c10b1b760a248c053c/cf 2023-07-15 22:12:17,021 DEBUG [StoreOpener-2cfccaac24cf77c10b1b760a248c053c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportFileSystemStateWithMergeRegion/2cfccaac24cf77c10b1b760a248c053c/cf 2023-07-15 22:12:17,022 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1689459136638.04cd49c752c2756f78caadf55b5e204a. 2023-07-15 22:12:17,022 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 04cd49c752c2756f78caadf55b5e204a, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689459136638.04cd49c752c2756f78caadf55b5e204a.', STARTKEY => '', ENDKEY => '1'} 2023-07-15 22:12:17,022 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1689459136638.04cd49c752c2756f78caadf55b5e204a. service=AccessControlService 2023-07-15 22:12:17,022 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 22:12:17,023 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 04cd49c752c2756f78caadf55b5e204a 2023-07-15 22:12:17,023 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689459136638.04cd49c752c2756f78caadf55b5e204a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 22:12:17,023 INFO [StoreOpener-2cfccaac24cf77c10b1b760a248c053c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2cfccaac24cf77c10b1b760a248c053c columnFamilyName cf 2023-07-15 22:12:17,023 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 04cd49c752c2756f78caadf55b5e204a 2023-07-15 22:12:17,024 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 04cd49c752c2756f78caadf55b5e204a 2023-07-15 22:12:17,024 INFO [StoreOpener-2cfccaac24cf77c10b1b760a248c053c-1] regionserver.HStore(310): Store=2cfccaac24cf77c10b1b760a248c053c/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 22:12:17,026 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportFileSystemStateWithMergeRegion/2cfccaac24cf77c10b1b760a248c053c 2023-07-15 22:12:17,026 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportFileSystemStateWithMergeRegion/2cfccaac24cf77c10b1b760a248c053c 2023-07-15 22:12:17,026 INFO [StoreOpener-04cd49c752c2756f78caadf55b5e204a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 04cd49c752c2756f78caadf55b5e204a 2023-07-15 22:12:17,033 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 2cfccaac24cf77c10b1b760a248c053c 2023-07-15 22:12:17,036 DEBUG [StoreOpener-04cd49c752c2756f78caadf55b5e204a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportFileSystemStateWithMergeRegion/04cd49c752c2756f78caadf55b5e204a/cf 2023-07-15 22:12:17,036 DEBUG [StoreOpener-04cd49c752c2756f78caadf55b5e204a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportFileSystemStateWithMergeRegion/04cd49c752c2756f78caadf55b5e204a/cf 2023-07-15 22:12:17,037 INFO [StoreOpener-04cd49c752c2756f78caadf55b5e204a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 04cd49c752c2756f78caadf55b5e204a columnFamilyName cf 2023-07-15 22:12:17,038 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportFileSystemStateWithMergeRegion/2cfccaac24cf77c10b1b760a248c053c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 22:12:17,038 INFO [StoreOpener-04cd49c752c2756f78caadf55b5e204a-1] regionserver.HStore(310): Store=04cd49c752c2756f78caadf55b5e204a/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 22:12:17,038 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 2cfccaac24cf77c10b1b760a248c053c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62440018, jitterRate=-0.06957122683525085}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 22:12:17,038 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 2cfccaac24cf77c10b1b760a248c053c: 2023-07-15 22:12:17,039 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportFileSystemStateWithMergeRegion/04cd49c752c2756f78caadf55b5e204a 2023-07-15 22:12:17,039 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportFileSystemStateWithMergeRegion/04cd49c752c2756f78caadf55b5e204a 2023-07-15 22:12:17,039 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1689459136638.2cfccaac24cf77c10b1b760a248c053c., pid=60, masterSystemTime=1689459137012 2023-07-15 22:12:17,042 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1689459136638.2cfccaac24cf77c10b1b760a248c053c. 2023-07-15 22:12:17,042 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1689459136638.2cfccaac24cf77c10b1b760a248c053c. 2023-07-15 22:12:17,042 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=2cfccaac24cf77c10b1b760a248c053c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:17,043 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689459136638.2cfccaac24cf77c10b1b760a248c053c.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689459137042"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689459137042"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689459137042"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689459137042"}]},"ts":"1689459137042"} 2023-07-15 22:12:17,047 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=59 2023-07-15 22:12:17,048 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=59, state=SUCCESS; OpenRegionProcedure 2cfccaac24cf77c10b1b760a248c053c, server=jenkins-hbase4.apache.org,37287,1689459063311 in 186 msec 2023-07-15 22:12:17,049 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=2cfccaac24cf77c10b1b760a248c053c, ASSIGN in 349 msec 2023-07-15 22:12:17,051 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 04cd49c752c2756f78caadf55b5e204a 2023-07-15 22:12:17,054 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportFileSystemStateWithMergeRegion/04cd49c752c2756f78caadf55b5e204a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 22:12:17,054 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 04cd49c752c2756f78caadf55b5e204a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66587697, jitterRate=-0.0077659934759140015}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 22:12:17,054 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 04cd49c752c2756f78caadf55b5e204a: 2023-07-15 22:12:17,055 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1689459136638.04cd49c752c2756f78caadf55b5e204a., pid=61, masterSystemTime=1689459137018 2023-07-15 22:12:17,057 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1689459136638.04cd49c752c2756f78caadf55b5e204a. 2023-07-15 22:12:17,057 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1689459136638.04cd49c752c2756f78caadf55b5e204a. 2023-07-15 22:12:17,057 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=04cd49c752c2756f78caadf55b5e204a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:17,058 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689459136638.04cd49c752c2756f78caadf55b5e204a.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689459137057"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689459137057"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689459137057"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689459137057"}]},"ts":"1689459137057"} 2023-07-15 22:12:17,062 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=58 2023-07-15 22:12:17,062 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=58, state=SUCCESS; OpenRegionProcedure 04cd49c752c2756f78caadf55b5e204a, server=jenkins-hbase4.apache.org,46037,1689459063224 in 197 msec 2023-07-15 22:12:17,064 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=58, resume processing ppid=57 2023-07-15 22:12:17,064 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=04cd49c752c2756f78caadf55b5e204a, ASSIGN in 363 msec 2023-07-15 22:12:17,065 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-15 22:12:17,065 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689459137065"}]},"ts":"1689459137065"} 2023-07-15 22:12:17,067 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-07-15 22:12:17,069 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-07-15 22:12:17,069 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-07-15 22:12:17,071 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38193] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-15 22:12:17,073 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 22:12:17,073 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 22:12:17,073 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 22:12:17,074 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 22:12:17,076 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:17,076 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:17,076 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-15 22:12:17,076 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-15 22:12:17,076 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-15 22:12:17,077 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-15 22:12:17,079 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 438 msec 2023-07-15 22:12:17,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-15 22:12:17,247 INFO [Listener at jenkins-hbase4.apache.org/46535] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-07-15 22:12:17,247 DEBUG [Listener at jenkins-hbase4.apache.org/46535] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemStateWithMergeRegion get assigned. Timeout = 60000ms 2023-07-15 22:12:17,248 INFO [Listener at jenkins-hbase4.apache.org/46535] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 22:12:17,251 INFO [Listener at jenkins-hbase4.apache.org/46535] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemStateWithMergeRegion assigned to meta. Checking AM states. 2023-07-15 22:12:17,251 INFO [Listener at jenkins-hbase4.apache.org/46535] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 22:12:17,251 INFO [Listener at jenkins-hbase4.apache.org/46535] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemStateWithMergeRegion assigned. 2023-07-15 22:12:17,255 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-15 22:12:17,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689459137255 (current time:1689459137255). 2023-07-15 22:12:17,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 22:12:17,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] zookeeper.ReadOnlyZKClient(139): Connect 0x76b6a563 to 127.0.0.1:53678 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 22:12:17,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@b00cb98, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 22:12:17,265 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 22:12:17,266 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45460, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 22:12:17,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x76b6a563 to 127.0.0.1:53678 2023-07-15 22:12:17,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 22:12:17,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] zookeeper.ReadOnlyZKClient(139): Connect 0x0d1fda06 to 127.0.0.1:53678 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 22:12:17,274 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4ec1eb7b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 22:12:17,276 DEBUG [hconnection-0x4390a530-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 22:12:17,280 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45464, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 22:12:17,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0d1fda06 to 127.0.0.1:53678 2023-07-15 22:12:17,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 22:12:17,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-15 22:12:17,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 22:12:17,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-15 22:12:17,290 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-15 22:12:17,292 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-15 22:12:17,296 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689459737296 2023-07-15 22:12:17,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-15 22:12:17,296 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:17,298 DEBUG [Listener at jenkins-hbase4.apache.org/46535] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 22:12:17,298 DEBUG [Listener at jenkins-hbase4.apache.org/46535] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 22:12:17,298 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-15 22:12:17,299 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-15 22:12:17,301 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 10 msec 2023-07-15 22:12:17,303 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-15 22:12:17,305 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689459737305 2023-07-15 22:12:17,325 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:17,325 INFO [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-15 22:12:17,325 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 22:12:17,327 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-15 22:12:17,327 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-15 22:12:17,328 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:17,328 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:17,330 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:12:17,330 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:12:17,330 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:12:17,330 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:12:17,330 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:17,330 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:12:17,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:12:17,331 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:12:17,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:12:17,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:12:17,331 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:17,331 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:17,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:17,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:17,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:17,332 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:17,332 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 22:12:17,332 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:17,332 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:17,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-15 22:12:17,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:17,332 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:17,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-15 22:12:17,333 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-15 22:12:17,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:17,333 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-15 22:12:17,333 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:17,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-15 22:12:17,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:17,333 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-15 22:12:17,333 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:17,333 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-15 22:12:17,333 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 22:12:17,333 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-15 22:12:17,335 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-15 22:12:17,335 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-15 22:12:17,335 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46037,1689459063224' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-15 22:12:17,335 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 22:12:17,335 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:17,343 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-15 22:12:17,343 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-15 22:12:17,343 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 22:12:17,343 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-15 22:12:17,343 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38193,1689459063370' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-15 22:12:17,344 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-15 22:12:17,344 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-15 22:12:17,344 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37287,1689459063311' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-15 22:12:17,345 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:17,345 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:17,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:17,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:12:17,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:12:17,346 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:17,347 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:17,347 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 22:12:17,347 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:17,347 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:17,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:12:17,347 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 22:12:17,347 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:17,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:12:17,348 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:17,348 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 22:12:17,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:17,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:12:17,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:17,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:17,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:12:17,349 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46037,1689459063224' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-15 22:12:17,349 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@378c5131[Count = 1] remaining members to acquire global barrier 2023-07-15 22:12:17,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:17,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:12:17,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:12:17,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:12:17,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:12:17,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:17,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:12:17,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:17,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:17,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:12:17,352 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37287,1689459063311' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-15 22:12:17,352 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@378c5131[Count = 0] remaining members to acquire global barrier 2023-07-15 22:12:17,352 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-15 22:12:17,352 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:17,354 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:17,354 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:17,354 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:17,354 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:17,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:17,354 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-15 22:12:17,354 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-15 22:12:17,354 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,38193,1689459063370' in zk 2023-07-15 22:12:17,354 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:17,354 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:17,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:17,354 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:17,355 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-15 22:12:17,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:17,355 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-15 22:12:17,355 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 22:12:17,355 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 22:12:17,355 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 22:12:17,355 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 22:12:17,355 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:17,355 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 22:12:17,355 DEBUG [rs(jenkins-hbase4.apache.org,37287,1689459063311)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689459136638.2cfccaac24cf77c10b1b760a248c053c. 2023-07-15 22:12:17,355 DEBUG [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689459136638.04cd49c752c2756f78caadf55b5e204a. 2023-07-15 22:12:17,355 DEBUG [rs(jenkins-hbase4.apache.org,37287,1689459063311)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689459136638.2cfccaac24cf77c10b1b760a248c053c. started... 2023-07-15 22:12:17,355 DEBUG [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689459136638.04cd49c752c2756f78caadf55b5e204a. started... 2023-07-15 22:12:17,357 DEBUG [rs(jenkins-hbase4.apache.org,37287,1689459063311)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2cfccaac24cf77c10b1b760a248c053c: 2023-07-15 22:12:17,357 DEBUG [rs(jenkins-hbase4.apache.org,37287,1689459063311)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689459136638.2cfccaac24cf77c10b1b760a248c053c.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:17,357 DEBUG [rs(jenkins-hbase4.apache.org,37287,1689459063311)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 22:12:17,358 DEBUG [rs(jenkins-hbase4.apache.org,37287,1689459063311)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-15 22:12:17,358 DEBUG [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 04cd49c752c2756f78caadf55b5e204a: 2023-07-15 22:12:17,358 DEBUG [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689459136638.04cd49c752c2756f78caadf55b5e204a.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:17,358 DEBUG [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 22:12:17,358 DEBUG [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-15 22:12:17,364 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-15 22:12:17,364 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 22:12:17,364 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-15 22:12:17,391 DEBUG [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689459136638.04cd49c752c2756f78caadf55b5e204a. completed. 2023-07-15 22:12:17,391 DEBUG [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689459136638.04cd49c752c2756f78caadf55b5e204a. 2023-07-15 22:12:17,391 DEBUG [rs(jenkins-hbase4.apache.org,37287,1689459063311)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689459136638.2cfccaac24cf77c10b1b760a248c053c. completed. 2023-07-15 22:12:17,391 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 22:12:17,391 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 22:12:17,391 DEBUG [rs(jenkins-hbase4.apache.org,37287,1689459063311)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689459136638.2cfccaac24cf77c10b1b760a248c053c. 2023-07-15 22:12:17,391 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:17,391 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 22:12:17,391 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 22:12:17,391 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-15 22:12:17,391 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:17,391 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,46037,1689459063224' in zk 2023-07-15 22:12:17,392 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-15 22:12:17,392 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,37287,1689459063311' in zk 2023-07-15 22:12:17,393 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-15 22:12:17,393 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 22:12:17,393 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-15 22:12:17,398 DEBUG [Listener at jenkins-hbase4.apache.org/46535] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 22:12:17,399 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:17,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:17,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:12:17,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:12:17,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-15 22:12:17,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-15 22:12:17,399 DEBUG [Listener at jenkins-hbase4.apache.org/46535] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 22:12:17,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:12:17,404 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:17,404 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-15 22:12:17,404 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 22:12:17,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:12:17,404 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-15 22:12:17,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:17,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:12:17,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:17,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:17,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:12:17,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:17,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:12:17,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:17,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:17,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,46037,1689459063224': 2023-07-15 22:12:17,409 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46037,1689459063224' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-15 22:12:17,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:17,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:12:17,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:12:17,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:12:17,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:12:17,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:17,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:12:17,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:17,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:17,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:12:17,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:17,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:12:17,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:17,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:17,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,37287,1689459063311': 2023-07-15 22:12:17,418 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37287,1689459063311' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-15 22:12:17,418 INFO [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-15 22:12:17,418 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 22:12:17,418 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 22:12:17,418 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:17,418 INFO [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 22:12:17,420 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:17,420 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:17,420 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:17,420 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:17,420 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:17,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:17,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:17,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:12:17,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:12:17,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:17,420 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:12:17,420 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:12:17,420 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:17,421 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:12:17,421 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:17,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:17,421 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:12:17,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:12:17,421 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:12:17,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:12:17,421 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:12:17,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:17,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:12:17,421 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:12:17,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:12:17,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:17,422 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:17,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:17,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:17,423 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:17,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:12:17,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:17,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:12:17,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:17,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:17,425 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:12:17,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:12:17,425 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:17,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:17,425 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:17,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:12:17,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:17,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:17,431 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:12:17,431 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:12:17,431 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:12:17,431 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:12:17,431 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:17,431 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:17,431 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:17,431 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:12:17,431 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:17,431 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:17,431 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:17,431 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:17,431 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:12:17,431 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:17,431 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:12:17,431 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:17,431 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:17,431 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 22:12:17,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:12:17,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:12:17,431 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:12:17,435 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:12:17,435 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:12:17,431 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:12:17,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:12:17,432 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:17,435 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:17,435 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:12:17,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:12:17,436 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:12:17,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:12:17,436 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:12:17,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:12:17,477 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:17,512 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-15 22:12:17,512 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:17,512 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:17,512 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689459137296Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689459137431 (+135 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689459137432 (+1 ms)Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689459137444 (+12 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689459137467 (+23 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689459137512 (+45 ms) 2023-07-15 22:12:17,516 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-15 22:12:17,517 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 218 msec 2023-07-15 22:12:17,600 DEBUG [Listener at jenkins-hbase4.apache.org/46535] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 22:12:17,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-15 22:12:17,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 22:12:17,611 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46037] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1689459136638.04cd49c752c2756f78caadf55b5e204a. with WAL disabled. Data may be lost in the event of a crash. 2023-07-15 22:12:17,613 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37287] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1689459136638.2cfccaac24cf77c10b1b760a248c053c. with WAL disabled. Data may be lost in the event of a crash. 2023-07-15 22:12:17,621 DEBUG [Listener at jenkins-hbase4.apache.org/46535] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:17,621 DEBUG [Listener at jenkins-hbase4.apache.org/46535] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689459136638.04cd49c752c2756f78caadf55b5e204a. 2023-07-15 22:12:17,621 INFO [Listener at jenkins-hbase4.apache.org/46535] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 22:12:17,649 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-15 22:12:17,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689459137649 (current time:1689459137649). 2023-07-15 22:12:17,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 22:12:17,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] zookeeper.ReadOnlyZKClient(139): Connect 0x70af0d4d to 127.0.0.1:53678 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 22:12:17,661 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4c8e0304, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 22:12:17,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 22:12:17,667 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45480, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 22:12:17,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x70af0d4d to 127.0.0.1:53678 2023-07-15 22:12:17,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 22:12:17,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] zookeeper.ReadOnlyZKClient(139): Connect 0x50740f86 to 127.0.0.1:53678 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 22:12:17,678 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@58b9a5a0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 22:12:17,680 DEBUG [hconnection-0x64131b90-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 22:12:17,681 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45488, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 22:12:17,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x50740f86 to 127.0.0.1:53678 2023-07-15 22:12:17,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 22:12:17,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-15 22:12:17,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 22:12:17,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-15 22:12:17,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-15 22:12:17,692 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-15 22:12:17,693 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689459737693 2023-07-15 22:12:17,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-15 22:12:17,693 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:17,694 DEBUG [Listener at jenkins-hbase4.apache.org/46535] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 22:12:17,694 DEBUG [Listener at jenkins-hbase4.apache.org/46535] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 22:12:17,695 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-15 22:12:17,695 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-15 22:12:17,696 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 5 msec 2023-07-15 22:12:17,697 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-15 22:12:17,698 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689459737698 2023-07-15 22:12:17,727 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:17,727 INFO [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-15 22:12:17,727 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 22:12:17,729 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-15 22:12:17,729 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-15 22:12:17,791 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:17,791 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:17,793 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:12:17,793 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:17,793 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:12:17,793 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:12:17,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:12:17,794 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:12:17,794 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:12:17,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:12:17,794 DEBUG [Listener at jenkins-hbase4.apache.org/46535] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 22:12:17,793 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:12:17,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-15 22:12:17,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:12:17,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-15 22:12:17,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:17,796 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:17,796 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:17,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:17,796 DEBUG [Listener at jenkins-hbase4.apache.org/46535] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 22:12:17,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:17,796 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:17,796 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:17,796 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 22:12:17,796 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:17,796 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:17,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-15 22:12:17,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:17,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-15 22:12:17,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-15 22:12:17,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:17,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:17,797 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-15 22:12:17,797 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-15 22:12:17,797 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-15 22:12:17,797 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:17,797 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-15 22:12:17,797 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:17,797 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:17,797 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 22:12:17,797 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-15 22:12:17,799 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-15 22:12:17,797 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-15 22:12:17,799 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-15 22:12:17,799 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 22:12:17,799 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38193,1689459063370' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-15 22:12:17,800 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-15 22:12:17,800 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-15 22:12:17,800 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37287,1689459063311' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-15 22:12:17,799 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 22:12:17,801 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-15 22:12:17,801 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-15 22:12:17,801 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46037,1689459063224' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-15 22:12:17,802 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:17,803 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:17,803 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:17,803 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:17,803 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:17,804 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:17,804 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 22:12:17,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:17,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:12:17,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:12:17,804 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:17,804 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 22:12:17,804 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:17,804 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 22:12:17,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:12:17,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:12:17,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:17,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:12:17,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:17,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:17,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:12:17,809 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37287,1689459063311' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-15 22:12:17,809 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7ca4b5ed[Count = 1] remaining members to acquire global barrier 2023-07-15 22:12:17,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:17,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:12:17,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:12:17,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:12:17,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:12:17,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:17,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:12:17,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:17,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:17,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:12:17,818 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46037,1689459063224' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-15 22:12:17,818 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-15 22:12:17,818 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7ca4b5ed[Count = 0] remaining members to acquire global barrier 2023-07-15 22:12:17,818 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:17,821 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:17,821 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:17,821 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:17,821 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:17,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:17,821 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:17,821 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-15 22:12:17,821 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:17,821 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:17,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:17,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:17,822 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-15 22:12:17,822 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-15 22:12:17,822 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,38193,1689459063370' in zk 2023-07-15 22:12:17,822 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-15 22:12:17,822 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:17,822 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 22:12:17,823 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-15 22:12:17,823 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 22:12:17,824 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-15 22:12:17,832 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 22:12:17,834 DEBUG [rs(jenkins-hbase4.apache.org,37287,1689459063311)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689459136638.2cfccaac24cf77c10b1b760a248c053c. 2023-07-15 22:12:17,834 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 22:12:17,834 DEBUG [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689459136638.04cd49c752c2756f78caadf55b5e204a. 2023-07-15 22:12:17,834 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 22:12:17,835 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 22:12:17,835 DEBUG [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689459136638.04cd49c752c2756f78caadf55b5e204a. started... 2023-07-15 22:12:17,834 DEBUG [rs(jenkins-hbase4.apache.org,37287,1689459063311)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689459136638.2cfccaac24cf77c10b1b760a248c053c. started... 2023-07-15 22:12:17,835 INFO [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 04cd49c752c2756f78caadf55b5e204a 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-15 22:12:17,835 INFO [rs(jenkins-hbase4.apache.org,37287,1689459063311)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 2cfccaac24cf77c10b1b760a248c053c 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-15 22:12:17,847 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-15 22:12:17,890 INFO [rs(jenkins-hbase4.apache.org,37287,1689459063311)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.00 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportFileSystemStateWithMergeRegion/2cfccaac24cf77c10b1b760a248c053c/.tmp/cf/5e57350fe1fe4ab08980b3368a31d5a5 2023-07-15 22:12:17,900 INFO [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=266 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportFileSystemStateWithMergeRegion/04cd49c752c2756f78caadf55b5e204a/.tmp/cf/198bb3576147403691fdadc5d1038d2f 2023-07-15 22:12:17,904 DEBUG [rs(jenkins-hbase4.apache.org,37287,1689459063311)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportFileSystemStateWithMergeRegion/2cfccaac24cf77c10b1b760a248c053c/.tmp/cf/5e57350fe1fe4ab08980b3368a31d5a5 as hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportFileSystemStateWithMergeRegion/2cfccaac24cf77c10b1b760a248c053c/cf/5e57350fe1fe4ab08980b3368a31d5a5 2023-07-15 22:12:17,910 DEBUG [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportFileSystemStateWithMergeRegion/04cd49c752c2756f78caadf55b5e204a/.tmp/cf/198bb3576147403691fdadc5d1038d2f as hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportFileSystemStateWithMergeRegion/04cd49c752c2756f78caadf55b5e204a/cf/198bb3576147403691fdadc5d1038d2f 2023-07-15 22:12:17,911 INFO [rs(jenkins-hbase4.apache.org,37287,1689459063311)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportFileSystemStateWithMergeRegion/2cfccaac24cf77c10b1b760a248c053c/cf/5e57350fe1fe4ab08980b3368a31d5a5, entries=46, sequenceid=6, filesize=7.9 K 2023-07-15 22:12:17,912 INFO [rs(jenkins-hbase4.apache.org,37287,1689459063311)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 2cfccaac24cf77c10b1b760a248c053c in 77ms, sequenceid=6, compaction requested=false 2023-07-15 22:12:17,914 DEBUG [rs(jenkins-hbase4.apache.org,37287,1689459063311)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2cfccaac24cf77c10b1b760a248c053c: 2023-07-15 22:12:17,915 DEBUG [rs(jenkins-hbase4.apache.org,37287,1689459063311)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689459136638.2cfccaac24cf77c10b1b760a248c053c.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:17,915 DEBUG [rs(jenkins-hbase4.apache.org,37287,1689459063311)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 22:12:17,915 DEBUG [rs(jenkins-hbase4.apache.org,37287,1689459063311)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportFileSystemStateWithMergeRegion/2cfccaac24cf77c10b1b760a248c053c/cf/5e57350fe1fe4ab08980b3368a31d5a5] hfiles 2023-07-15 22:12:17,915 DEBUG [rs(jenkins-hbase4.apache.org,37287,1689459063311)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportFileSystemStateWithMergeRegion/2cfccaac24cf77c10b1b760a248c053c/cf/5e57350fe1fe4ab08980b3368a31d5a5 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:17,937 INFO [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportFileSystemStateWithMergeRegion/04cd49c752c2756f78caadf55b5e204a/cf/198bb3576147403691fdadc5d1038d2f, entries=4, sequenceid=6, filesize=5.1 K 2023-07-15 22:12:17,938 INFO [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 04cd49c752c2756f78caadf55b5e204a in 103ms, sequenceid=6, compaction requested=false 2023-07-15 22:12:17,938 DEBUG [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 04cd49c752c2756f78caadf55b5e204a: 2023-07-15 22:12:17,938 DEBUG [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689459136638.04cd49c752c2756f78caadf55b5e204a.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:17,938 DEBUG [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 22:12:17,938 DEBUG [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportFileSystemStateWithMergeRegion/04cd49c752c2756f78caadf55b5e204a/cf/198bb3576147403691fdadc5d1038d2f] hfiles 2023-07-15 22:12:17,938 DEBUG [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportFileSystemStateWithMergeRegion/04cd49c752c2756f78caadf55b5e204a/cf/198bb3576147403691fdadc5d1038d2f for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:17,972 DEBUG [rs(jenkins-hbase4.apache.org,37287,1689459063311)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689459136638.2cfccaac24cf77c10b1b760a248c053c. completed. 2023-07-15 22:12:17,972 DEBUG [rs(jenkins-hbase4.apache.org,37287,1689459063311)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689459136638.2cfccaac24cf77c10b1b760a248c053c. 2023-07-15 22:12:17,972 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 22:12:17,972 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 22:12:17,972 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:17,972 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-15 22:12:17,972 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,37287,1689459063311' in zk 2023-07-15 22:12:17,974 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:17,974 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-15 22:12:17,975 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 22:12:17,975 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-15 22:12:17,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:17,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:12:17,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:12:17,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:12:17,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:12:17,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:17,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:12:17,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:17,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:17,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:12:17,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:17,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:12:17,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:17,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,37287,1689459063311': 2023-07-15 22:12:17,980 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37287,1689459063311' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-15 22:12:17,996 DEBUG [Listener at jenkins-hbase4.apache.org/46535] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 22:12:17,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-15 22:12:17,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-15 22:12:17,998 DEBUG [Listener at jenkins-hbase4.apache.org/46535] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-15 22:12:18,298 DEBUG [Listener at jenkins-hbase4.apache.org/46535] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 22:12:18,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-15 22:12:18,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-15 22:12:18,302 DEBUG [Listener at jenkins-hbase4.apache.org/46535] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-15 22:12:18,406 DEBUG [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689459136638.04cd49c752c2756f78caadf55b5e204a. completed. 2023-07-15 22:12:18,407 DEBUG [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689459136638.04cd49c752c2756f78caadf55b5e204a. 2023-07-15 22:12:18,414 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 22:12:18,414 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 22:12:18,414 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:18,414 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-15 22:12:18,414 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,46037,1689459063224' in zk 2023-07-15 22:12:18,416 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-15 22:12:18,417 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 22:12:18,417 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-15 22:12:18,418 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:18,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:18,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:12:18,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:12:18,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:12:18,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:12:18,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:18,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:12:18,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:18,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:18,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:12:18,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:18,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:12:18,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:18,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:18,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,46037,1689459063224': 2023-07-15 22:12:18,424 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46037,1689459063224' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-15 22:12:18,424 INFO [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-15 22:12:18,424 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 22:12:18,424 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 22:12:18,424 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:18,424 INFO [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 22:12:18,435 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:18,435 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:12:18,435 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:18,435 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:18,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:18,436 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:18,436 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:18,436 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:18,436 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:18,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:18,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:12:18,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:12:18,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:18,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:18,436 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:12:18,436 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:12:18,436 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:12:18,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:12:18,437 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:12:18,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:12:18,437 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:12:18,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:12:18,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:12:18,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:18,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:18,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:18,438 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:12:18,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:18,438 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:18,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:12:18,439 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:18,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:18,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:12:18,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:18,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:18,441 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:12:18,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:12:18,442 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:18,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:18,443 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:18,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:12:18,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:18,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:18,447 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:12:18,447 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:12:18,447 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:12:18,447 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:12:18,447 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:12:18,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:12:18,447 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:18,447 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:18,447 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:18,447 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:12:18,447 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:18,447 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:18,447 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:12:18,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:12:18,447 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:12:18,448 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:18,447 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:18,448 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:12:18,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:12:18,448 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:12:18,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:12:18,447 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 22:12:18,448 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:18,451 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:18,451 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:12:18,451 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:18,451 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:18,448 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:12:18,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:12:18,448 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:12:18,451 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:18,451 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:12:18,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:12:18,539 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:18,583 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-15 22:12:18,583 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:18,584 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:18,584 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689459137693Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689459138448 (+755 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1689459138448Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1689459138472 (+24 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689459138526 (+54 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689459138583 (+57 ms) 2023-07-15 22:12:18,587 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-15 22:12:18,589 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 893 msec 2023-07-15 22:12:18,802 DEBUG [Listener at jenkins-hbase4.apache.org/46535] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 22:12:18,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-15 22:12:18,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 22:12:18,856 DEBUG [Listener at jenkins-hbase4.apache.org/46535] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-15 22:12:18,860 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45354, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-15 22:12:18,862 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37287] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-15 22:12:18,862 DEBUG [Listener at jenkins-hbase4.apache.org/46535] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-15 22:12:18,879 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45492, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-15 22:12:18,879 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38193] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-15 22:12:18,880 DEBUG [Listener at jenkins-hbase4.apache.org/46535] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-15 22:12:18,900 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48162, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-15 22:12:18,901 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46037] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-15 22:12:18,903 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-15 22:12:18,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] procedure2.ProcedureExecutor(1029): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:18,908 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-15 22:12:18,908 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-07-15 22:12:18,909 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-15 22:12:18,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-15 22:12:18,915 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7ad525169b0e02324bd32b4dc9d28dde 2023-07-15 22:12:18,915 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b1040ba9b45c43d5fd1af35b30e798a4 2023-07-15 22:12:18,915 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7ad525169b0e02324bd32b4dc9d28dde empty. 2023-07-15 22:12:18,915 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b1040ba9b45c43d5fd1af35b30e798a4 empty. 2023-07-15 22:12:18,916 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7ad525169b0e02324bd32b4dc9d28dde 2023-07-15 22:12:18,916 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b1040ba9b45c43d5fd1af35b30e798a4 2023-07-15 22:12:18,916 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-15 22:12:18,969 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-07-15 22:12:18,971 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 7ad525169b0e02324bd32b4dc9d28dde, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689459138903.7ad525169b0e02324bd32b4dc9d28dde.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp 2023-07-15 22:12:18,974 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => b1040ba9b45c43d5fd1af35b30e798a4, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689459138903.b1040ba9b45c43d5fd1af35b30e798a4.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp 2023-07-15 22:12:19,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-15 22:12:19,014 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689459138903.b1040ba9b45c43d5fd1af35b30e798a4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 22:12:19,014 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing b1040ba9b45c43d5fd1af35b30e798a4, disabling compactions & flushes 2023-07-15 22:12:19,014 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689459138903.b1040ba9b45c43d5fd1af35b30e798a4. 2023-07-15 22:12:19,014 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689459138903.b1040ba9b45c43d5fd1af35b30e798a4. 2023-07-15 22:12:19,014 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689459138903.b1040ba9b45c43d5fd1af35b30e798a4. after waiting 0 ms 2023-07-15 22:12:19,014 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689459138903.b1040ba9b45c43d5fd1af35b30e798a4. 2023-07-15 22:12:19,014 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689459138903.b1040ba9b45c43d5fd1af35b30e798a4. 2023-07-15 22:12:19,014 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for b1040ba9b45c43d5fd1af35b30e798a4: 2023-07-15 22:12:19,019 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689459138903.7ad525169b0e02324bd32b4dc9d28dde.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 22:12:19,019 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing 7ad525169b0e02324bd32b4dc9d28dde, disabling compactions & flushes 2023-07-15 22:12:19,020 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689459138903.7ad525169b0e02324bd32b4dc9d28dde. 2023-07-15 22:12:19,020 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689459138903.7ad525169b0e02324bd32b4dc9d28dde. 2023-07-15 22:12:19,020 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689459138903.7ad525169b0e02324bd32b4dc9d28dde. after waiting 0 ms 2023-07-15 22:12:19,020 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689459138903.7ad525169b0e02324bd32b4dc9d28dde. 2023-07-15 22:12:19,020 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689459138903.7ad525169b0e02324bd32b4dc9d28dde. 2023-07-15 22:12:19,020 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for 7ad525169b0e02324bd32b4dc9d28dde: 2023-07-15 22:12:19,023 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-07-15 22:12:19,024 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689459138903.b1040ba9b45c43d5fd1af35b30e798a4.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689459139024"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689459139024"}]},"ts":"1689459139024"} 2023-07-15 22:12:19,024 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689459138903.7ad525169b0e02324bd32b4dc9d28dde.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689459139024"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689459139024"}]},"ts":"1689459139024"} 2023-07-15 22:12:19,027 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-15 22:12:19,028 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-15 22:12:19,028 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689459139028"}]},"ts":"1689459139028"} 2023-07-15 22:12:19,030 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-07-15 22:12:19,034 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-15 22:12:19,036 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-15 22:12:19,036 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-15 22:12:19,036 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-15 22:12:19,036 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-15 22:12:19,036 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=7ad525169b0e02324bd32b4dc9d28dde, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b1040ba9b45c43d5fd1af35b30e798a4, ASSIGN}] 2023-07-15 22:12:19,040 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b1040ba9b45c43d5fd1af35b30e798a4, ASSIGN 2023-07-15 22:12:19,040 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=7ad525169b0e02324bd32b4dc9d28dde, ASSIGN 2023-07-15 22:12:19,042 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b1040ba9b45c43d5fd1af35b30e798a4, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38193,1689459063370; forceNewPlan=false, retain=false 2023-07-15 22:12:19,042 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=7ad525169b0e02324bd32b4dc9d28dde, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46037,1689459063224; forceNewPlan=false, retain=false 2023-07-15 22:12:19,193 INFO [jenkins-hbase4:42893] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-15 22:12:19,198 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=7ad525169b0e02324bd32b4dc9d28dde, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:19,198 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689459138903.7ad525169b0e02324bd32b4dc9d28dde.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689459139198"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689459139198"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689459139198"}]},"ts":"1689459139198"} 2023-07-15 22:12:19,198 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=b1040ba9b45c43d5fd1af35b30e798a4, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:12:19,199 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689459138903.b1040ba9b45c43d5fd1af35b30e798a4.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689459139198"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689459139198"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689459139198"}]},"ts":"1689459139198"} 2023-07-15 22:12:19,208 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure 7ad525169b0e02324bd32b4dc9d28dde, server=jenkins-hbase4.apache.org,46037,1689459063224}] 2023-07-15 22:12:19,212 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-15 22:12:19,215 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=70, ppid=68, state=RUNNABLE; OpenRegionProcedure b1040ba9b45c43d5fd1af35b30e798a4, server=jenkins-hbase4.apache.org,38193,1689459063370}] 2023-07-15 22:12:19,370 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689459138903.7ad525169b0e02324bd32b4dc9d28dde. 2023-07-15 22:12:19,371 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7ad525169b0e02324bd32b4dc9d28dde, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689459138903.7ad525169b0e02324bd32b4dc9d28dde.', STARTKEY => '', ENDKEY => '2'} 2023-07-15 22:12:19,372 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689459138903.7ad525169b0e02324bd32b4dc9d28dde. service=AccessControlService 2023-07-15 22:12:19,372 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 22:12:19,372 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 7ad525169b0e02324bd32b4dc9d28dde 2023-07-15 22:12:19,372 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689459138903.7ad525169b0e02324bd32b4dc9d28dde.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 22:12:19,372 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 7ad525169b0e02324bd32b4dc9d28dde 2023-07-15 22:12:19,372 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 7ad525169b0e02324bd32b4dc9d28dde 2023-07-15 22:12:19,391 INFO [StoreOpener-7ad525169b0e02324bd32b4dc9d28dde-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 7ad525169b0e02324bd32b4dc9d28dde 2023-07-15 22:12:19,394 DEBUG [StoreOpener-7ad525169b0e02324bd32b4dc9d28dde-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7ad525169b0e02324bd32b4dc9d28dde/cf 2023-07-15 22:12:19,395 DEBUG [StoreOpener-7ad525169b0e02324bd32b4dc9d28dde-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7ad525169b0e02324bd32b4dc9d28dde/cf 2023-07-15 22:12:19,395 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1689459138903.b1040ba9b45c43d5fd1af35b30e798a4. 2023-07-15 22:12:19,395 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b1040ba9b45c43d5fd1af35b30e798a4, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689459138903.b1040ba9b45c43d5fd1af35b30e798a4.', STARTKEY => '2', ENDKEY => ''} 2023-07-15 22:12:19,395 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1689459138903.b1040ba9b45c43d5fd1af35b30e798a4. service=AccessControlService 2023-07-15 22:12:19,395 INFO [StoreOpener-7ad525169b0e02324bd32b4dc9d28dde-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7ad525169b0e02324bd32b4dc9d28dde columnFamilyName cf 2023-07-15 22:12:19,395 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 22:12:19,396 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 b1040ba9b45c43d5fd1af35b30e798a4 2023-07-15 22:12:19,396 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689459138903.b1040ba9b45c43d5fd1af35b30e798a4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 22:12:19,396 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b1040ba9b45c43d5fd1af35b30e798a4 2023-07-15 22:12:19,396 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b1040ba9b45c43d5fd1af35b30e798a4 2023-07-15 22:12:19,396 INFO [StoreOpener-7ad525169b0e02324bd32b4dc9d28dde-1] regionserver.HStore(310): Store=7ad525169b0e02324bd32b4dc9d28dde/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 22:12:19,397 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7ad525169b0e02324bd32b4dc9d28dde 2023-07-15 22:12:19,397 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7ad525169b0e02324bd32b4dc9d28dde 2023-07-15 22:12:19,403 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 7ad525169b0e02324bd32b4dc9d28dde 2023-07-15 22:12:19,411 INFO [StoreOpener-b1040ba9b45c43d5fd1af35b30e798a4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region b1040ba9b45c43d5fd1af35b30e798a4 2023-07-15 22:12:19,417 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7ad525169b0e02324bd32b4dc9d28dde/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 22:12:19,418 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 7ad525169b0e02324bd32b4dc9d28dde; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69399286, jitterRate=0.034129947423934937}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 22:12:19,418 DEBUG [StoreOpener-b1040ba9b45c43d5fd1af35b30e798a4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b1040ba9b45c43d5fd1af35b30e798a4/cf 2023-07-15 22:12:19,418 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 7ad525169b0e02324bd32b4dc9d28dde: 2023-07-15 22:12:19,418 DEBUG [StoreOpener-b1040ba9b45c43d5fd1af35b30e798a4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b1040ba9b45c43d5fd1af35b30e798a4/cf 2023-07-15 22:12:19,419 INFO [StoreOpener-b1040ba9b45c43d5fd1af35b30e798a4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b1040ba9b45c43d5fd1af35b30e798a4 columnFamilyName cf 2023-07-15 22:12:19,419 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689459138903.7ad525169b0e02324bd32b4dc9d28dde., pid=69, masterSystemTime=1689459139366 2023-07-15 22:12:19,419 INFO [StoreOpener-b1040ba9b45c43d5fd1af35b30e798a4-1] regionserver.HStore(310): Store=b1040ba9b45c43d5fd1af35b30e798a4/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 22:12:19,420 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b1040ba9b45c43d5fd1af35b30e798a4 2023-07-15 22:12:19,421 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b1040ba9b45c43d5fd1af35b30e798a4 2023-07-15 22:12:19,422 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=7ad525169b0e02324bd32b4dc9d28dde, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:19,422 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689459138903.7ad525169b0e02324bd32b4dc9d28dde.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689459139422"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689459139422"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689459139422"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689459139422"}]},"ts":"1689459139422"} 2023-07-15 22:12:19,424 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689459138903.7ad525169b0e02324bd32b4dc9d28dde. 2023-07-15 22:12:19,424 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689459138903.7ad525169b0e02324bd32b4dc9d28dde. 2023-07-15 22:12:19,427 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b1040ba9b45c43d5fd1af35b30e798a4 2023-07-15 22:12:19,439 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b1040ba9b45c43d5fd1af35b30e798a4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 22:12:19,439 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=67 2023-07-15 22:12:19,440 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure 7ad525169b0e02324bd32b4dc9d28dde, server=jenkins-hbase4.apache.org,46037,1689459063224 in 222 msec 2023-07-15 22:12:19,440 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b1040ba9b45c43d5fd1af35b30e798a4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58859761, jitterRate=-0.12292121350765228}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 22:12:19,440 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b1040ba9b45c43d5fd1af35b30e798a4: 2023-07-15 22:12:19,441 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689459138903.b1040ba9b45c43d5fd1af35b30e798a4., pid=70, masterSystemTime=1689459139368 2023-07-15 22:12:19,442 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=7ad525169b0e02324bd32b4dc9d28dde, ASSIGN in 404 msec 2023-07-15 22:12:19,443 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=b1040ba9b45c43d5fd1af35b30e798a4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:12:19,443 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689459138903.b1040ba9b45c43d5fd1af35b30e798a4. 2023-07-15 22:12:19,444 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1689459138903.b1040ba9b45c43d5fd1af35b30e798a4. 2023-07-15 22:12:19,444 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689459138903.b1040ba9b45c43d5fd1af35b30e798a4.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689459139443"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689459139443"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689459139443"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689459139443"}]},"ts":"1689459139443"} 2023-07-15 22:12:19,448 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=70, resume processing ppid=68 2023-07-15 22:12:19,448 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=68, state=SUCCESS; OpenRegionProcedure b1040ba9b45c43d5fd1af35b30e798a4, server=jenkins-hbase4.apache.org,38193,1689459063370 in 231 msec 2023-07-15 22:12:19,450 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=68, resume processing ppid=66 2023-07-15 22:12:19,450 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b1040ba9b45c43d5fd1af35b30e798a4, ASSIGN in 412 msec 2023-07-15 22:12:19,451 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-15 22:12:19,451 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689459139451"}]},"ts":"1689459139451"} 2023-07-15 22:12:19,453 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-07-15 22:12:19,456 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-07-15 22:12:19,457 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-07-15 22:12:19,460 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38193] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-15 22:12:19,463 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 22:12:19,463 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 22:12:19,463 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 22:12:19,463 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 22:12:19,465 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-15 22:12:19,465 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-15 22:12:19,465 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-15 22:12:19,465 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-15 22:12:19,466 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:19,466 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:19,466 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:19,467 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-15 22:12:19,467 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-15 22:12:19,467 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:19,467 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-15 22:12:19,467 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-15 22:12:19,470 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 564 msec 2023-07-15 22:12:19,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-15 22:12:19,514 INFO [Listener at jenkins-hbase4.apache.org/46535] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-07-15 22:12:19,557 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions 7ad525169b0e02324bd32b4dc9d28dde, b1040ba9b45c43d5fd1af35b30e798a4 2023-07-15 22:12:19,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[7ad525169b0e02324bd32b4dc9d28dde, b1040ba9b45c43d5fd1af35b30e798a4], force=true 2023-07-15 22:12:19,577 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[7ad525169b0e02324bd32b4dc9d28dde, b1040ba9b45c43d5fd1af35b30e798a4], force=true 2023-07-15 22:12:19,577 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[7ad525169b0e02324bd32b4dc9d28dde, b1040ba9b45c43d5fd1af35b30e798a4], force=true 2023-07-15 22:12:19,577 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[7ad525169b0e02324bd32b4dc9d28dde, b1040ba9b45c43d5fd1af35b30e798a4], force=true 2023-07-15 22:12:19,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-15 22:12:19,614 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=7ad525169b0e02324bd32b4dc9d28dde, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b1040ba9b45c43d5fd1af35b30e798a4, UNASSIGN}] 2023-07-15 22:12:19,616 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=7ad525169b0e02324bd32b4dc9d28dde, UNASSIGN 2023-07-15 22:12:19,617 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=7ad525169b0e02324bd32b4dc9d28dde, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:19,618 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689459138903.7ad525169b0e02324bd32b4dc9d28dde.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689459139617"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689459139617"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689459139617"}]},"ts":"1689459139617"} 2023-07-15 22:12:19,620 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=74, ppid=72, state=RUNNABLE; CloseRegionProcedure 7ad525169b0e02324bd32b4dc9d28dde, server=jenkins-hbase4.apache.org,46037,1689459063224}] 2023-07-15 22:12:19,626 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b1040ba9b45c43d5fd1af35b30e798a4, UNASSIGN 2023-07-15 22:12:19,627 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=b1040ba9b45c43d5fd1af35b30e798a4, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:12:19,627 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689459138903.b1040ba9b45c43d5fd1af35b30e798a4.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689459139627"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689459139627"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689459139627"}]},"ts":"1689459139627"} 2023-07-15 22:12:19,629 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=75, ppid=73, state=RUNNABLE; CloseRegionProcedure b1040ba9b45c43d5fd1af35b30e798a4, server=jenkins-hbase4.apache.org,38193,1689459063370}] 2023-07-15 22:12:19,698 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-15 22:12:19,772 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 7ad525169b0e02324bd32b4dc9d28dde 2023-07-15 22:12:19,774 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 7ad525169b0e02324bd32b4dc9d28dde, disabling compactions & flushes 2023-07-15 22:12:19,774 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689459138903.7ad525169b0e02324bd32b4dc9d28dde. 2023-07-15 22:12:19,774 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689459138903.7ad525169b0e02324bd32b4dc9d28dde. 2023-07-15 22:12:19,774 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689459138903.7ad525169b0e02324bd32b4dc9d28dde. after waiting 0 ms 2023-07-15 22:12:19,774 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689459138903.7ad525169b0e02324bd32b4dc9d28dde. 2023-07-15 22:12:19,774 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 7ad525169b0e02324bd32b4dc9d28dde 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-15 22:12:19,786 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close b1040ba9b45c43d5fd1af35b30e798a4 2023-07-15 22:12:19,792 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b1040ba9b45c43d5fd1af35b30e798a4, disabling compactions & flushes 2023-07-15 22:12:19,792 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689459138903.b1040ba9b45c43d5fd1af35b30e798a4. 2023-07-15 22:12:19,792 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689459138903.b1040ba9b45c43d5fd1af35b30e798a4. 2023-07-15 22:12:19,792 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689459138903.b1040ba9b45c43d5fd1af35b30e798a4. after waiting 0 ms 2023-07-15 22:12:19,792 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689459138903.b1040ba9b45c43d5fd1af35b30e798a4. 2023-07-15 22:12:19,792 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing b1040ba9b45c43d5fd1af35b30e798a4 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-15 22:12:19,795 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7ad525169b0e02324bd32b4dc9d28dde/.tmp/cf/8c5fdc342f5c44cfb0faadeafc2d4867 2023-07-15 22:12:19,802 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7ad525169b0e02324bd32b4dc9d28dde/.tmp/cf/8c5fdc342f5c44cfb0faadeafc2d4867 as hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7ad525169b0e02324bd32b4dc9d28dde/cf/8c5fdc342f5c44cfb0faadeafc2d4867 2023-07-15 22:12:19,812 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7ad525169b0e02324bd32b4dc9d28dde/cf/8c5fdc342f5c44cfb0faadeafc2d4867, entries=1, sequenceid=5, filesize=4.7 K 2023-07-15 22:12:19,813 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 7ad525169b0e02324bd32b4dc9d28dde in 39ms, sequenceid=5, compaction requested=false 2023-07-15 22:12:19,813 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-15 22:12:19,824 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b1040ba9b45c43d5fd1af35b30e798a4/.tmp/cf/5acee19ab9404f0bbc882b94981da02b 2023-07-15 22:12:19,828 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7ad525169b0e02324bd32b4dc9d28dde/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-15 22:12:19,829 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 22:12:19,829 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689459138903.7ad525169b0e02324bd32b4dc9d28dde. 2023-07-15 22:12:19,829 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 7ad525169b0e02324bd32b4dc9d28dde: 2023-07-15 22:12:19,831 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 7ad525169b0e02324bd32b4dc9d28dde 2023-07-15 22:12:19,831 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b1040ba9b45c43d5fd1af35b30e798a4/.tmp/cf/5acee19ab9404f0bbc882b94981da02b as hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b1040ba9b45c43d5fd1af35b30e798a4/cf/5acee19ab9404f0bbc882b94981da02b 2023-07-15 22:12:19,832 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=7ad525169b0e02324bd32b4dc9d28dde, regionState=CLOSED 2023-07-15 22:12:19,832 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689459138903.7ad525169b0e02324bd32b4dc9d28dde.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689459139832"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689459139832"}]},"ts":"1689459139832"} 2023-07-15 22:12:19,837 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=74, resume processing ppid=72 2023-07-15 22:12:19,837 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=72, state=SUCCESS; CloseRegionProcedure 7ad525169b0e02324bd32b4dc9d28dde, server=jenkins-hbase4.apache.org,46037,1689459063224 in 214 msec 2023-07-15 22:12:19,838 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b1040ba9b45c43d5fd1af35b30e798a4/cf/5acee19ab9404f0bbc882b94981da02b, entries=1, sequenceid=5, filesize=4.7 K 2023-07-15 22:12:19,839 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for b1040ba9b45c43d5fd1af35b30e798a4 in 47ms, sequenceid=5, compaction requested=false 2023-07-15 22:12:19,841 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=7ad525169b0e02324bd32b4dc9d28dde, UNASSIGN in 228 msec 2023-07-15 22:12:19,857 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b1040ba9b45c43d5fd1af35b30e798a4/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-15 22:12:19,858 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 22:12:19,858 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689459138903.b1040ba9b45c43d5fd1af35b30e798a4. 2023-07-15 22:12:19,858 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b1040ba9b45c43d5fd1af35b30e798a4: 2023-07-15 22:12:19,860 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed b1040ba9b45c43d5fd1af35b30e798a4 2023-07-15 22:12:19,860 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=b1040ba9b45c43d5fd1af35b30e798a4, regionState=CLOSED 2023-07-15 22:12:19,860 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689459138903.b1040ba9b45c43d5fd1af35b30e798a4.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689459139860"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689459139860"}]},"ts":"1689459139860"} 2023-07-15 22:12:19,864 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=75, resume processing ppid=73 2023-07-15 22:12:19,864 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=73, state=SUCCESS; CloseRegionProcedure b1040ba9b45c43d5fd1af35b30e798a4, server=jenkins-hbase4.apache.org,38193,1689459063370 in 233 msec 2023-07-15 22:12:19,865 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=73, resume processing ppid=71 2023-07-15 22:12:19,866 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b1040ba9b45c43d5fd1af35b30e798a4, UNASSIGN in 251 msec 2023-07-15 22:12:19,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-15 22:12:19,961 DEBUG [PEWorker-3] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/81a8530211e1629b462bf51f41b2d254/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-15 22:12:19,964 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689459138903.7ad525169b0e02324bd32b4dc9d28dde.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-15 22:12:19,964 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689459138903.b1040ba9b45c43d5fd1af35b30e798a4.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-15 22:12:19,964 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689459138904.81a8530211e1629b462bf51f41b2d254.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-15 22:12:20,020 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=81a8530211e1629b462bf51f41b2d254, ASSIGN}] 2023-07-15 22:12:20,023 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=81a8530211e1629b462bf51f41b2d254, ASSIGN 2023-07-15 22:12:20,024 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=81a8530211e1629b462bf51f41b2d254, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,46037,1689459063224; forceNewPlan=false, retain=false 2023-07-15 22:12:20,174 INFO [jenkins-hbase4:42893] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-15 22:12:20,178 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=81a8530211e1629b462bf51f41b2d254, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:20,178 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689459138904.81a8530211e1629b462bf51f41b2d254.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689459140178"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689459140178"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689459140178"}]},"ts":"1689459140178"} 2023-07-15 22:12:20,185 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure 81a8530211e1629b462bf51f41b2d254, server=jenkins-hbase4.apache.org,46037,1689459063224}] 2023-07-15 22:12:20,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-15 22:12:20,345 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689459138904.81a8530211e1629b462bf51f41b2d254. 2023-07-15 22:12:20,346 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 81a8530211e1629b462bf51f41b2d254, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689459138904.81a8530211e1629b462bf51f41b2d254.', STARTKEY => '', ENDKEY => ''} 2023-07-15 22:12:20,346 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689459138904.81a8530211e1629b462bf51f41b2d254. service=AccessControlService 2023-07-15 22:12:20,346 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 22:12:20,347 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 81a8530211e1629b462bf51f41b2d254 2023-07-15 22:12:20,347 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689459138904.81a8530211e1629b462bf51f41b2d254.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 22:12:20,347 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 81a8530211e1629b462bf51f41b2d254 2023-07-15 22:12:20,347 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 81a8530211e1629b462bf51f41b2d254 2023-07-15 22:12:20,348 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/81a8530211e1629b462bf51f41b2d254/.regioninfo 2023-07-15 22:12:20,414 INFO [StoreOpener-81a8530211e1629b462bf51f41b2d254-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 81a8530211e1629b462bf51f41b2d254 2023-07-15 22:12:20,415 DEBUG [StoreOpener-81a8530211e1629b462bf51f41b2d254-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/81a8530211e1629b462bf51f41b2d254/cf 2023-07-15 22:12:20,415 DEBUG [StoreOpener-81a8530211e1629b462bf51f41b2d254-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/81a8530211e1629b462bf51f41b2d254/cf 2023-07-15 22:12:20,415 INFO [StoreOpener-81a8530211e1629b462bf51f41b2d254-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 81a8530211e1629b462bf51f41b2d254 columnFamilyName cf 2023-07-15 22:12:20,449 DEBUG [StoreOpener-81a8530211e1629b462bf51f41b2d254-1] regionserver.HStore(539): loaded hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/81a8530211e1629b462bf51f41b2d254/cf/5acee19ab9404f0bbc882b94981da02b.b1040ba9b45c43d5fd1af35b30e798a4->hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b1040ba9b45c43d5fd1af35b30e798a4/cf/5acee19ab9404f0bbc882b94981da02b-top 2023-07-15 22:12:20,457 DEBUG [StoreOpener-81a8530211e1629b462bf51f41b2d254-1] regionserver.HStore(539): loaded hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/81a8530211e1629b462bf51f41b2d254/cf/8c5fdc342f5c44cfb0faadeafc2d4867.7ad525169b0e02324bd32b4dc9d28dde->hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7ad525169b0e02324bd32b4dc9d28dde/cf/8c5fdc342f5c44cfb0faadeafc2d4867-top 2023-07-15 22:12:20,458 INFO [StoreOpener-81a8530211e1629b462bf51f41b2d254-1] regionserver.HStore(310): Store=81a8530211e1629b462bf51f41b2d254/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 22:12:20,459 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/81a8530211e1629b462bf51f41b2d254 2023-07-15 22:12:20,461 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/81a8530211e1629b462bf51f41b2d254 2023-07-15 22:12:20,465 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 81a8530211e1629b462bf51f41b2d254 2023-07-15 22:12:20,466 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 81a8530211e1629b462bf51f41b2d254; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69627619, jitterRate=0.03753237426280975}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 22:12:20,466 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 81a8530211e1629b462bf51f41b2d254: 2023-07-15 22:12:20,467 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689459138904.81a8530211e1629b462bf51f41b2d254., pid=77, masterSystemTime=1689459140337 2023-07-15 22:12:20,468 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1689459138904.81a8530211e1629b462bf51f41b2d254.,because compaction is disabled. 2023-07-15 22:12:20,470 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689459138904.81a8530211e1629b462bf51f41b2d254. 2023-07-15 22:12:20,470 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689459138904.81a8530211e1629b462bf51f41b2d254. 2023-07-15 22:12:20,470 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=81a8530211e1629b462bf51f41b2d254, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:20,471 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689459138904.81a8530211e1629b462bf51f41b2d254.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689459140470"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689459140470"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689459140470"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689459140470"}]},"ts":"1689459140470"} 2023-07-15 22:12:20,476 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-15 22:12:20,476 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure 81a8530211e1629b462bf51f41b2d254, server=jenkins-hbase4.apache.org,46037,1689459063224 in 288 msec 2023-07-15 22:12:20,483 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=71 2023-07-15 22:12:20,483 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=81a8530211e1629b462bf51f41b2d254, ASSIGN in 456 msec 2023-07-15 22:12:20,486 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[7ad525169b0e02324bd32b4dc9d28dde, b1040ba9b45c43d5fd1af35b30e798a4], force=true in 917 msec 2023-07-15 22:12:20,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-15 22:12:20,703 INFO [Listener at jenkins-hbase4.apache.org/46535] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-07-15 22:12:20,707 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-15 22:12:20,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689459140707 (current time:1689459140707). 2023-07-15 22:12:20,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 22:12:20,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] zookeeper.ReadOnlyZKClient(139): Connect 0x5e2495c5 to 127.0.0.1:53678 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 22:12:20,718 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@41eeb13e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 22:12:20,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 22:12:20,722 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49302, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 22:12:20,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5e2495c5 to 127.0.0.1:53678 2023-07-15 22:12:20,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 22:12:20,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] zookeeper.ReadOnlyZKClient(139): Connect 0x33411cea to 127.0.0.1:53678 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 22:12:20,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@49b12dfa, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 22:12:20,763 DEBUG [hconnection-0x7de202b3-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 22:12:20,767 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49304, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 22:12:20,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x33411cea to 127.0.0.1:53678 2023-07-15 22:12:20,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 22:12:20,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-15 22:12:20,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 22:12:20,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-15 22:12:20,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-15 22:12:20,790 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-15 22:12:20,790 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1689459740790 2023-07-15 22:12:20,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-15 22:12:20,790 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:20,798 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-15 22:12:20,798 DEBUG [Listener at jenkins-hbase4.apache.org/46535] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 22:12:20,798 DEBUG [Listener at jenkins-hbase4.apache.org/46535] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 22:12:20,798 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-15 22:12:20,801 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 11 msec 2023-07-15 22:12:20,802 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-15 22:12:20,803 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1689459740803 2023-07-15 22:12:20,850 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689459070788_0004_000001 (auth:SIMPLE) 2023-07-15 22:12:20,866 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:20,867 INFO [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-07-15 22:12:20,867 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 22:12:20,868 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-07-15 22:12:20,868 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-07-15 22:12:20,889 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:20,889 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:20,892 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:12:20,892 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:12:20,892 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:12:20,892 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:12:20,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:12:20,892 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:20,892 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:12:20,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:12:20,893 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:12:20,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:12:20,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:20,893 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:20,893 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 22:12:20,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:20,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:20,893 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:20,894 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:20,894 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:20,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-15 22:12:20,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:20,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-15 22:12:20,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:20,894 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-15 22:12:20,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-15 22:12:20,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:20,894 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-15 22:12:20,894 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-15 22:12:20,894 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:20,895 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-15 22:12:20,895 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 22:12:20,895 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:20,895 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-15 22:12:20,895 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 22:12:20,897 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-15 22:12:20,897 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:20,897 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-15 22:12:20,897 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38193,1689459063370' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-15 22:12:20,897 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-15 22:12:20,897 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-15 22:12:20,897 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-15 22:12:20,897 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 22:12:20,898 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46037,1689459063224' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-15 22:12:20,899 DEBUG [Listener at jenkins-hbase4.apache.org/46535] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 22:12:20,899 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-15 22:12:20,899 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-15 22:12:20,899 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37287,1689459063311' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-15 22:12:20,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-15 22:12:20,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-15 22:12:20,900 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:20,900 DEBUG [Listener at jenkins-hbase4.apache.org/46535] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 22:12:20,901 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:20,902 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:20,902 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:20,902 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:20,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:20,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:12:20,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:12:20,902 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 22:12:20,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:12:20,902 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:20,902 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:20,902 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 22:12:20,902 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 22:12:20,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:12:20,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:20,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:12:20,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:20,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:20,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:12:20,909 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46037,1689459063224' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-07-15 22:12:20,909 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@383845b7[Count = 0] remaining members to acquire global barrier 2023-07-15 22:12:20,909 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-07-15 22:12:20,909 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:20,910 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:20,910 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:20,910 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:20,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:20,910 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:20,911 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-15 22:12:20,911 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-15 22:12:20,911 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,37287,1689459063311' in zk 2023-07-15 22:12:20,910 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:20,911 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:20,911 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 22:12:20,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:20,911 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:20,911 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-15 22:12:20,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:20,911 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-15 22:12:20,911 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-15 22:12:20,911 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,38193,1689459063370' in zk 2023-07-15 22:12:20,914 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-15 22:12:20,914 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 22:12:20,914 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 22:12:20,920 DEBUG [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689459138904.81a8530211e1629b462bf51f41b2d254. 2023-07-15 22:12:20,920 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 22:12:20,914 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-15 22:12:20,920 DEBUG [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689459138904.81a8530211e1629b462bf51f41b2d254. started... 2023-07-15 22:12:20,922 DEBUG [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 81a8530211e1629b462bf51f41b2d254: 2023-07-15 22:12:20,922 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-15 22:12:20,922 DEBUG [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689459138904.81a8530211e1629b462bf51f41b2d254.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:20,922 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 22:12:20,922 DEBUG [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 22:12:20,922 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-15 22:12:20,927 DEBUG [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/81a8530211e1629b462bf51f41b2d254/cf/5acee19ab9404f0bbc882b94981da02b.b1040ba9b45c43d5fd1af35b30e798a4->hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b1040ba9b45c43d5fd1af35b30e798a4/cf/5acee19ab9404f0bbc882b94981da02b-top, hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/81a8530211e1629b462bf51f41b2d254/cf/8c5fdc342f5c44cfb0faadeafc2d4867.7ad525169b0e02324bd32b4dc9d28dde->hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7ad525169b0e02324bd32b4dc9d28dde/cf/8c5fdc342f5c44cfb0faadeafc2d4867-top] hfiles 2023-07-15 22:12:20,927 DEBUG [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/81a8530211e1629b462bf51f41b2d254/cf/5acee19ab9404f0bbc882b94981da02b.b1040ba9b45c43d5fd1af35b30e798a4 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:20,928 DEBUG [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/81a8530211e1629b462bf51f41b2d254/cf/8c5fdc342f5c44cfb0faadeafc2d4867.7ad525169b0e02324bd32b4dc9d28dde for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:20,958 DEBUG [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689459138904.81a8530211e1629b462bf51f41b2d254. completed. 2023-07-15 22:12:20,958 DEBUG [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689459138904.81a8530211e1629b462bf51f41b2d254. 2023-07-15 22:12:20,958 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 22:12:20,958 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 22:12:20,958 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:20,958 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-15 22:12:20,958 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,46037,1689459063224' in zk 2023-07-15 22:12:20,963 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-15 22:12:20,964 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 22:12:20,963 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:20,964 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-15 22:12:20,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:20,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:12:20,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:12:20,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:12:20,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:12:20,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:20,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:12:20,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:20,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:20,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:12:20,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:20,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:12:20,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:20,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:20,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,46037,1689459063224': 2023-07-15 22:12:20,968 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46037,1689459063224' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-07-15 22:12:20,968 INFO [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-07-15 22:12:20,968 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 22:12:20,969 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 22:12:20,969 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:20,969 INFO [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 22:12:20,970 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:20,971 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:20,971 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:20,971 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:20,971 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:20,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:20,971 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:12:20,971 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:20,971 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:12:20,971 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:20,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:20,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:20,971 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:12:20,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:20,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:12:20,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:12:20,971 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:12:20,972 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:12:20,972 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:12:20,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:12:20,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:12:20,972 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:12:20,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:12:20,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:12:20,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:20,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:20,972 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:20,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:20,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:20,973 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:20,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:12:20,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:20,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:12:20,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:20,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:20,975 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:12:20,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:12:20,975 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:20,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:20,976 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:20,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:12:20,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:20,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:20,979 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:20,979 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:12:20,979 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:12:20,979 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:12:20,979 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:12:20,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:12:20,979 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:20,980 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:20,980 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:12:20,980 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:12:20,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:12:20,980 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:12:20,980 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:12:20,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:12:20,980 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:12:20,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:12:20,980 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:12:20,982 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:12:20,983 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:12:20,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:12:20,983 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 22:12:20,983 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:20,983 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:20,983 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:12:20,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:12:20,984 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:20,984 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:20,984 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:20,984 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:20,984 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:20,984 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:12:20,984 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:20,984 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:21,026 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:21,063 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-07-15 22:12:21,063 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:21,064 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:21,064 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1689459140791Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689459140983 (+192 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689459140983Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689459140989 (+6 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689459141006 (+17 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1689459141063 (+57 ms) 2023-07-15 22:12:21,066 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-15 22:12:21,068 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 273 msec 2023-07-15 22:12:21,101 DEBUG [Listener at jenkins-hbase4.apache.org/46535] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 22:12:21,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-15 22:12:21,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 22:12:21,102 INFO [Listener at jenkins-hbase4.apache.org/46535] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/export-test/export-1689459141102 2023-07-15 22:12:21,102 INFO [Listener at jenkins-hbase4.apache.org/46535] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:33847, tgtDir=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/export-test/export-1689459141102, rawTgtDir=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/export-test/export-1689459141102, srcFsUri=hdfs://localhost:33847, srcDir=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e 2023-07-15 22:12:21,162 DEBUG [Listener at jenkins-hbase4.apache.org/46535] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:33847, inputRoot=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e 2023-07-15 22:12:21,163 DEBUG [Listener at jenkins-hbase4.apache.org/46535] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1337791942_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/export-test/export-1689459141102, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/export-test/export-1689459141102/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:21,163 INFO [Listener at jenkins-hbase4.apache.org/46535] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:33847, inputRoot=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e, snapshotDir=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-07-15 22:12:21,190 INFO [Listener at jenkins-hbase4.apache.org/46535] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/export-test/export-1689459141102/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:21,375 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-15 22:12:21,376 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-15 22:12:21,376 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-15 22:12:21,377 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-15 22:12:21,377 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-15 22:12:21,378 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-15 22:12:21,378 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-15 22:12:21,492 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97e758c6-fe86-0ed9-092f-cd0594d33e04/hadoop-6642451670461499358.jar 2023-07-15 22:12:21,493 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-15 22:12:21,494 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-15 22:12:21,494 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-15 22:12:21,495 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-15 22:12:21,495 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-15 22:12:21,496 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-15 22:12:21,496 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-15 22:12:21,497 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-15 22:12:21,497 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-15 22:12:21,498 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-15 22:12:21,498 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-15 22:12:21,499 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-15 22:12:21,500 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-15 22:12:21,500 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-15 22:12:21,500 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-15 22:12:21,501 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-15 22:12:21,502 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 22:12:21,502 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 22:12:21,503 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 22:12:21,503 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 22:12:21,503 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 22:12:21,504 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 22:12:21,505 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 22:12:21,948 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-15 22:12:22,635 WARN [Listener at jenkins-hbase4.apache.org/46535] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-15 22:12:22,638 INFO [Listener at jenkins-hbase4.apache.org/46535] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-07-15 22:12:22,641 DEBUG [Listener at jenkins-hbase4.apache.org/46535] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-07-15 22:12:22,811 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 22:12:22,811 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 22:12:22,826 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689459070788_0005_000001 (auth:SIMPLE) 2023-07-15 22:12:28,187 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689459070788_0005_000001 (auth:SIMPLE) 2023-07-15 22:12:30,510 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689459070788_0005_000001 (auth:SIMPLE) 2023-07-15 22:12:36,008 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689459070788_0005_000001 (auth:SIMPLE) 2023-07-15 22:12:38,003 INFO [Listener at jenkins-hbase4.apache.org/46535] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-15 22:12:38,004 INFO [Listener at jenkins-hbase4.apache.org/46535] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-15 22:12:38,018 INFO [Listener at jenkins-hbase4.apache.org/46535] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:38,018 INFO [Listener at jenkins-hbase4.apache.org/46535] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-15 22:12:38,019 INFO [Listener at jenkins-hbase4.apache.org/46535] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-15 22:12:38,019 DEBUG [Listener at jenkins-hbase4.apache.org/46535] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2077448059_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:38,019 DEBUG [Listener at jenkins-hbase4.apache.org/46535] snapshot.TestExportSnapshot(367): hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-15 22:12:38,019 DEBUG [Listener at jenkins-hbase4.apache.org/46535] snapshot.TestExportSnapshot(367): hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-15 22:12:38,020 DEBUG [Listener at jenkins-hbase4.apache.org/46535] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2077448059_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/export-test/export-1689459141102/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/export-test/export-1689459141102/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:38,020 DEBUG [Listener at jenkins-hbase4.apache.org/46535] snapshot.TestExportSnapshot(367): hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/export-test/export-1689459141102/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-15 22:12:38,020 DEBUG [Listener at jenkins-hbase4.apache.org/46535] snapshot.TestExportSnapshot(367): hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/export-test/export-1689459141102/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-15 22:12:38,032 INFO [Listener at jenkins-hbase4.apache.org/46535] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:38,033 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:38,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] procedure2.ProcedureExecutor(1029): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:38,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-15 22:12:38,039 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689459158039"}]},"ts":"1689459158039"} 2023-07-15 22:12:38,041 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-07-15 22:12:38,043 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-07-15 22:12:38,045 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=81a8530211e1629b462bf51f41b2d254, UNASSIGN}] 2023-07-15 22:12:38,048 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=81a8530211e1629b462bf51f41b2d254, UNASSIGN 2023-07-15 22:12:38,050 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=81a8530211e1629b462bf51f41b2d254, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:38,050 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689459138904.81a8530211e1629b462bf51f41b2d254.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689459158049"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689459158049"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689459158049"}]},"ts":"1689459158049"} 2023-07-15 22:12:38,055 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure 81a8530211e1629b462bf51f41b2d254, server=jenkins-hbase4.apache.org,46037,1689459063224}] 2023-07-15 22:12:38,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-15 22:12:38,208 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 81a8530211e1629b462bf51f41b2d254 2023-07-15 22:12:38,208 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 81a8530211e1629b462bf51f41b2d254, disabling compactions & flushes 2023-07-15 22:12:38,208 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689459138904.81a8530211e1629b462bf51f41b2d254. 2023-07-15 22:12:38,208 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689459138904.81a8530211e1629b462bf51f41b2d254. 2023-07-15 22:12:38,208 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689459138904.81a8530211e1629b462bf51f41b2d254. after waiting 0 ms 2023-07-15 22:12:38,208 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689459138904.81a8530211e1629b462bf51f41b2d254. 2023-07-15 22:12:38,220 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/81a8530211e1629b462bf51f41b2d254/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-15 22:12:38,221 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 22:12:38,222 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689459138904.81a8530211e1629b462bf51f41b2d254. 2023-07-15 22:12:38,222 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 81a8530211e1629b462bf51f41b2d254: 2023-07-15 22:12:38,224 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 81a8530211e1629b462bf51f41b2d254 2023-07-15 22:12:38,225 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=81a8530211e1629b462bf51f41b2d254, regionState=CLOSED 2023-07-15 22:12:38,225 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689459138904.81a8530211e1629b462bf51f41b2d254.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689459158225"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689459158225"}]},"ts":"1689459158225"} 2023-07-15 22:12:38,230 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=81 2023-07-15 22:12:38,230 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure 81a8530211e1629b462bf51f41b2d254, server=jenkins-hbase4.apache.org,46037,1689459063224 in 172 msec 2023-07-15 22:12:38,232 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=80 2023-07-15 22:12:38,232 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=81a8530211e1629b462bf51f41b2d254, UNASSIGN in 185 msec 2023-07-15 22:12:38,232 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689459158232"}]},"ts":"1689459158232"} 2023-07-15 22:12:38,234 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-07-15 22:12:38,235 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-07-15 22:12:38,237 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 203 msec 2023-07-15 22:12:38,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-15 22:12:38,341 INFO [Listener at jenkins-hbase4.apache.org/46535] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-07-15 22:12:38,343 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:38,344 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] procedure2.ProcedureExecutor(1029): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:38,347 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:38,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:38,348 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:38,357 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38193] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:38,358 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b1040ba9b45c43d5fd1af35b30e798a4 2023-07-15 22:12:38,358 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/81a8530211e1629b462bf51f41b2d254 2023-07-15 22:12:38,358 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7ad525169b0e02324bd32b4dc9d28dde 2023-07-15 22:12:38,360 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:38,360 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:38,360 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:38,360 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:38,360 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-15 22:12:38,360 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-15 22:12:38,360 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-15 22:12:38,361 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-15 22:12:38,361 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b1040ba9b45c43d5fd1af35b30e798a4/cf, FileablePath, hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b1040ba9b45c43d5fd1af35b30e798a4/recovered.edits] 2023-07-15 22:12:38,362 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/81a8530211e1629b462bf51f41b2d254/cf, FileablePath, hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/81a8530211e1629b462bf51f41b2d254/recovered.edits] 2023-07-15 22:12:38,362 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7ad525169b0e02324bd32b4dc9d28dde/cf, FileablePath, hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7ad525169b0e02324bd32b4dc9d28dde/recovered.edits] 2023-07-15 22:12:38,362 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:38,362 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:38,363 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 22:12:38,363 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 22:12:38,363 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:38,363 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:38,363 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 22:12:38,363 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 22:12:38,364 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-15 22:12:38,364 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-15 22:12:38,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-15 22:12:38,365 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-15 22:12:38,365 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-15 22:12:38,370 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b1040ba9b45c43d5fd1af35b30e798a4/cf/5acee19ab9404f0bbc882b94981da02b to hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b1040ba9b45c43d5fd1af35b30e798a4/cf/5acee19ab9404f0bbc882b94981da02b 2023-07-15 22:12:38,374 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/81a8530211e1629b462bf51f41b2d254/cf/5acee19ab9404f0bbc882b94981da02b.b1040ba9b45c43d5fd1af35b30e798a4 to hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/81a8530211e1629b462bf51f41b2d254/cf/5acee19ab9404f0bbc882b94981da02b.b1040ba9b45c43d5fd1af35b30e798a4 2023-07-15 22:12:38,380 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b1040ba9b45c43d5fd1af35b30e798a4/recovered.edits/8.seqid to hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b1040ba9b45c43d5fd1af35b30e798a4/recovered.edits/8.seqid 2023-07-15 22:12:38,382 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7ad525169b0e02324bd32b4dc9d28dde/cf/8c5fdc342f5c44cfb0faadeafc2d4867 to hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7ad525169b0e02324bd32b4dc9d28dde/cf/8c5fdc342f5c44cfb0faadeafc2d4867 2023-07-15 22:12:38,382 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b1040ba9b45c43d5fd1af35b30e798a4 2023-07-15 22:12:38,388 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/81a8530211e1629b462bf51f41b2d254/cf/8c5fdc342f5c44cfb0faadeafc2d4867.7ad525169b0e02324bd32b4dc9d28dde to hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/81a8530211e1629b462bf51f41b2d254/cf/8c5fdc342f5c44cfb0faadeafc2d4867.7ad525169b0e02324bd32b4dc9d28dde 2023-07-15 22:12:38,388 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7ad525169b0e02324bd32b4dc9d28dde/recovered.edits/8.seqid to hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7ad525169b0e02324bd32b4dc9d28dde/recovered.edits/8.seqid 2023-07-15 22:12:38,389 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7ad525169b0e02324bd32b4dc9d28dde 2023-07-15 22:12:38,392 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/81a8530211e1629b462bf51f41b2d254/recovered.edits/12.seqid to hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/81a8530211e1629b462bf51f41b2d254/recovered.edits/12.seqid 2023-07-15 22:12:38,392 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/81a8530211e1629b462bf51f41b2d254 2023-07-15 22:12:38,392 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-15 22:12:38,395 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:38,397 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-07-15 22:12:38,401 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-07-15 22:12:38,402 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:38,402 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-07-15 22:12:38,402 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689459138904.81a8530211e1629b462bf51f41b2d254.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689459158402"}]},"ts":"9223372036854775807"} 2023-07-15 22:12:38,408 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-15 22:12:38,408 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 81a8530211e1629b462bf51f41b2d254, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689459138904.81a8530211e1629b462bf51f41b2d254.', STARTKEY => '', ENDKEY => ''}] 2023-07-15 22:12:38,409 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-07-15 22:12:38,409 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689459158409"}]},"ts":"9223372036854775807"} 2023-07-15 22:12:38,411 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-07-15 22:12:38,413 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:38,414 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 70 msec 2023-07-15 22:12:38,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-15 22:12:38,466 INFO [Listener at jenkins-hbase4.apache.org/46535] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-07-15 22:12:38,468 INFO [Listener at jenkins-hbase4.apache.org/46535] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:38,468 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:38,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] procedure2.ProcedureExecutor(1029): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:38,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-15 22:12:38,474 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689459158473"}]},"ts":"1689459158473"} 2023-07-15 22:12:38,479 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-07-15 22:12:38,481 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-07-15 22:12:38,482 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=04cd49c752c2756f78caadf55b5e204a, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=2cfccaac24cf77c10b1b760a248c053c, UNASSIGN}] 2023-07-15 22:12:38,486 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=04cd49c752c2756f78caadf55b5e204a, UNASSIGN 2023-07-15 22:12:38,486 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=2cfccaac24cf77c10b1b760a248c053c, UNASSIGN 2023-07-15 22:12:38,487 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=04cd49c752c2756f78caadf55b5e204a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:38,487 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=2cfccaac24cf77c10b1b760a248c053c, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:38,488 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689459136638.04cd49c752c2756f78caadf55b5e204a.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689459158487"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689459158487"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689459158487"}]},"ts":"1689459158487"} 2023-07-15 22:12:38,488 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689459136638.2cfccaac24cf77c10b1b760a248c053c.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689459158487"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689459158487"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689459158487"}]},"ts":"1689459158487"} 2023-07-15 22:12:38,489 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=85, state=RUNNABLE; CloseRegionProcedure 04cd49c752c2756f78caadf55b5e204a, server=jenkins-hbase4.apache.org,46037,1689459063224}] 2023-07-15 22:12:38,490 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=86, state=RUNNABLE; CloseRegionProcedure 2cfccaac24cf77c10b1b760a248c053c, server=jenkins-hbase4.apache.org,37287,1689459063311}] 2023-07-15 22:12:38,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-15 22:12:38,642 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 2cfccaac24cf77c10b1b760a248c053c 2023-07-15 22:12:38,642 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 04cd49c752c2756f78caadf55b5e204a 2023-07-15 22:12:38,643 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 2cfccaac24cf77c10b1b760a248c053c, disabling compactions & flushes 2023-07-15 22:12:38,643 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 04cd49c752c2756f78caadf55b5e204a, disabling compactions & flushes 2023-07-15 22:12:38,643 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689459136638.2cfccaac24cf77c10b1b760a248c053c. 2023-07-15 22:12:38,643 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689459136638.04cd49c752c2756f78caadf55b5e204a. 2023-07-15 22:12:38,643 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689459136638.2cfccaac24cf77c10b1b760a248c053c. 2023-07-15 22:12:38,643 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689459136638.04cd49c752c2756f78caadf55b5e204a. 2023-07-15 22:12:38,643 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689459136638.2cfccaac24cf77c10b1b760a248c053c. after waiting 0 ms 2023-07-15 22:12:38,643 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689459136638.04cd49c752c2756f78caadf55b5e204a. after waiting 0 ms 2023-07-15 22:12:38,643 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689459136638.04cd49c752c2756f78caadf55b5e204a. 2023-07-15 22:12:38,643 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689459136638.2cfccaac24cf77c10b1b760a248c053c. 2023-07-15 22:12:38,678 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportFileSystemStateWithMergeRegion/04cd49c752c2756f78caadf55b5e204a/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 22:12:38,679 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 22:12:38,681 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689459136638.04cd49c752c2756f78caadf55b5e204a. 2023-07-15 22:12:38,681 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 04cd49c752c2756f78caadf55b5e204a: 2023-07-15 22:12:38,682 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportFileSystemStateWithMergeRegion/2cfccaac24cf77c10b1b760a248c053c/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 22:12:38,683 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 04cd49c752c2756f78caadf55b5e204a 2023-07-15 22:12:38,683 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=04cd49c752c2756f78caadf55b5e204a, regionState=CLOSED 2023-07-15 22:12:38,683 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689459136638.04cd49c752c2756f78caadf55b5e204a.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689459158683"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689459158683"}]},"ts":"1689459158683"} 2023-07-15 22:12:38,684 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 22:12:38,686 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689459136638.2cfccaac24cf77c10b1b760a248c053c. 2023-07-15 22:12:38,686 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 2cfccaac24cf77c10b1b760a248c053c: 2023-07-15 22:12:38,687 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 2cfccaac24cf77c10b1b760a248c053c 2023-07-15 22:12:38,688 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=2cfccaac24cf77c10b1b760a248c053c, regionState=CLOSED 2023-07-15 22:12:38,688 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689459136638.2cfccaac24cf77c10b1b760a248c053c.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689459158688"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689459158688"}]},"ts":"1689459158688"} 2023-07-15 22:12:38,689 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=85 2023-07-15 22:12:38,690 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=85, state=SUCCESS; CloseRegionProcedure 04cd49c752c2756f78caadf55b5e204a, server=jenkins-hbase4.apache.org,46037,1689459063224 in 197 msec 2023-07-15 22:12:38,691 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=04cd49c752c2756f78caadf55b5e204a, UNASSIGN in 208 msec 2023-07-15 22:12:38,692 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=86 2023-07-15 22:12:38,692 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=86, state=SUCCESS; CloseRegionProcedure 2cfccaac24cf77c10b1b760a248c053c, server=jenkins-hbase4.apache.org,37287,1689459063311 in 200 msec 2023-07-15 22:12:38,694 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=86, resume processing ppid=84 2023-07-15 22:12:38,695 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=2cfccaac24cf77c10b1b760a248c053c, UNASSIGN in 210 msec 2023-07-15 22:12:38,695 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689459158695"}]},"ts":"1689459158695"} 2023-07-15 22:12:38,697 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-07-15 22:12:38,699 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-07-15 22:12:38,701 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 232 msec 2023-07-15 22:12:38,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-15 22:12:38,777 INFO [Listener at jenkins-hbase4.apache.org/46535] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-07-15 22:12:38,778 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:38,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] procedure2.ProcedureExecutor(1029): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:38,782 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:38,782 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:38,783 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:38,784 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38193] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:38,786 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:38,786 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:38,786 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:38,786 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:38,791 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-15 22:12:38,791 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-15 22:12:38,791 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-15 22:12:38,791 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/04cd49c752c2756f78caadf55b5e204a 2023-07-15 22:12:38,791 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-15 22:12:38,791 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/2cfccaac24cf77c10b1b760a248c053c 2023-07-15 22:12:38,793 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:38,793 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 22:12:38,793 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:38,793 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:38,793 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 22:12:38,793 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:38,793 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 22:12:38,793 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 22:12:38,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-15 22:12:38,795 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/04cd49c752c2756f78caadf55b5e204a/cf, FileablePath, hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/04cd49c752c2756f78caadf55b5e204a/recovered.edits] 2023-07-15 22:12:38,796 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/2cfccaac24cf77c10b1b760a248c053c/cf, FileablePath, hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/2cfccaac24cf77c10b1b760a248c053c/recovered.edits] 2023-07-15 22:12:38,808 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/04cd49c752c2756f78caadf55b5e204a/cf/198bb3576147403691fdadc5d1038d2f to hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/04cd49c752c2756f78caadf55b5e204a/cf/198bb3576147403691fdadc5d1038d2f 2023-07-15 22:12:38,808 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/2cfccaac24cf77c10b1b760a248c053c/cf/5e57350fe1fe4ab08980b3368a31d5a5 to hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/2cfccaac24cf77c10b1b760a248c053c/cf/5e57350fe1fe4ab08980b3368a31d5a5 2023-07-15 22:12:38,813 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/04cd49c752c2756f78caadf55b5e204a/recovered.edits/9.seqid to hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/04cd49c752c2756f78caadf55b5e204a/recovered.edits/9.seqid 2023-07-15 22:12:38,813 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/2cfccaac24cf77c10b1b760a248c053c/recovered.edits/9.seqid to hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/2cfccaac24cf77c10b1b760a248c053c/recovered.edits/9.seqid 2023-07-15 22:12:38,813 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/04cd49c752c2756f78caadf55b5e204a 2023-07-15 22:12:38,814 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/2cfccaac24cf77c10b1b760a248c053c 2023-07-15 22:12:38,814 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-15 22:12:38,816 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:38,818 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-07-15 22:12:38,821 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-07-15 22:12:38,822 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:38,822 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-07-15 22:12:38,822 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689459136638.04cd49c752c2756f78caadf55b5e204a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689459158822"}]},"ts":"9223372036854775807"} 2023-07-15 22:12:38,822 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689459136638.2cfccaac24cf77c10b1b760a248c053c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689459158822"}]},"ts":"9223372036854775807"} 2023-07-15 22:12:38,824 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-15 22:12:38,824 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 04cd49c752c2756f78caadf55b5e204a, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689459136638.04cd49c752c2756f78caadf55b5e204a.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 2cfccaac24cf77c10b1b760a248c053c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689459136638.2cfccaac24cf77c10b1b760a248c053c.', STARTKEY => '1', ENDKEY => ''}] 2023-07-15 22:12:38,824 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-07-15 22:12:38,824 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689459158824"}]},"ts":"9223372036854775807"} 2023-07-15 22:12:38,826 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-07-15 22:12:38,828 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:38,829 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 50 msec 2023-07-15 22:12:38,896 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-15 22:12:38,896 INFO [Listener at jenkins-hbase4.apache.org/46535] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-07-15 22:12:38,907 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-15 22:12:38,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42893] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:38,912 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-15 22:12:38,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 22:12:38,916 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-07-15 22:12:38,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 22:12:38,955 INFO [Listener at jenkins-hbase4.apache.org/46535] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=760 (was 747) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2077448059_17 at /127.0.0.1:34786 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2077448059_17 at /127.0.0.1:34014 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x57410306-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x57410306-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x57410306-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x57410306-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x57410306-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x57410306-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_742106836_1 at /127.0.0.1:48124 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (905985230) connection to jenkins-hbase4.apache.org/172.31.14.131:36311 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (905985230) connection to jenkins-hbase4.apache.org/172.31.14.131:38541 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2077448059_17 at /127.0.0.1:48134 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_742106836_1 at /127.0.0.1:34002 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-3825 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=907 (was 898) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=455 (was 342) - SystemLoadAverage LEAK? -, ProcessCount=185 (was 181) - ProcessCount LEAK? -, AvailableMemoryMB=2950 (was 3574) 2023-07-15 22:12:38,955 WARN [Listener at jenkins-hbase4.apache.org/46535] hbase.ResourceChecker(130): Thread=760 is superior to 500 2023-07-15 22:12:38,986 INFO [Listener at jenkins-hbase4.apache.org/46535] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testEmptyExportFileSystemState Thread=760, OpenFileDescriptor=907, MaxFileDescriptor=60000, SystemLoadAverage=455, ProcessCount=185, AvailableMemoryMB=2945 2023-07-15 22:12:38,986 WARN [Listener at jenkins-hbase4.apache.org/46535] hbase.ResourceChecker(130): Thread=760 is superior to 500 2023-07-15 22:12:38,988 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-15 22:12:38,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] procedure2.ProcedureExecutor(1029): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-15 22:12:38,996 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-15 22:12:38,996 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-07-15 22:12:38,997 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-15 22:12:38,999 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-15 22:12:38,999 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testEmptyExportFileSystemState/4bee573cb356c57aefc56750640bc150 2023-07-15 22:12:38,999 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testEmptyExportFileSystemState/154ee9daf455aa13fd742944244e6c61 2023-07-15 22:12:39,000 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testEmptyExportFileSystemState/4bee573cb356c57aefc56750640bc150 empty. 2023-07-15 22:12:39,000 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testEmptyExportFileSystemState/154ee9daf455aa13fd742944244e6c61 empty. 2023-07-15 22:12:39,001 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testEmptyExportFileSystemState/4bee573cb356c57aefc56750640bc150 2023-07-15 22:12:39,001 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testEmptyExportFileSystemState/154ee9daf455aa13fd742944244e6c61 2023-07-15 22:12:39,001 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-15 22:12:39,068 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-15 22:12:39,069 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 4bee573cb356c57aefc56750640bc150, NAME => 'testtb-testEmptyExportFileSystemState,,1689459158988.4bee573cb356c57aefc56750640bc150.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp 2023-07-15 22:12:39,085 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 154ee9daf455aa13fd742944244e6c61, NAME => 'testtb-testEmptyExportFileSystemState,1,1689459158988.154ee9daf455aa13fd742944244e6c61.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp 2023-07-15 22:12:39,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-15 22:12:39,167 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689459158988.4bee573cb356c57aefc56750640bc150.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 22:12:39,167 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 4bee573cb356c57aefc56750640bc150, disabling compactions & flushes 2023-07-15 22:12:39,167 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689459158988.4bee573cb356c57aefc56750640bc150. 2023-07-15 22:12:39,167 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689459158988.4bee573cb356c57aefc56750640bc150. 2023-07-15 22:12:39,167 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689459158988.4bee573cb356c57aefc56750640bc150. after waiting 0 ms 2023-07-15 22:12:39,168 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689459158988.4bee573cb356c57aefc56750640bc150. 2023-07-15 22:12:39,168 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689459158988.4bee573cb356c57aefc56750640bc150. 2023-07-15 22:12:39,168 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 4bee573cb356c57aefc56750640bc150: 2023-07-15 22:12:39,178 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689459158988.154ee9daf455aa13fd742944244e6c61.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 22:12:39,178 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 154ee9daf455aa13fd742944244e6c61, disabling compactions & flushes 2023-07-15 22:12:39,178 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689459158988.154ee9daf455aa13fd742944244e6c61. 2023-07-15 22:12:39,178 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689459158988.154ee9daf455aa13fd742944244e6c61. 2023-07-15 22:12:39,179 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689459158988.154ee9daf455aa13fd742944244e6c61. after waiting 0 ms 2023-07-15 22:12:39,179 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689459158988.154ee9daf455aa13fd742944244e6c61. 2023-07-15 22:12:39,179 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689459158988.154ee9daf455aa13fd742944244e6c61. 2023-07-15 22:12:39,179 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 154ee9daf455aa13fd742944244e6c61: 2023-07-15 22:12:39,181 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-15 22:12:39,183 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689459158988.4bee573cb356c57aefc56750640bc150.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689459159183"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689459159183"}]},"ts":"1689459159183"} 2023-07-15 22:12:39,183 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689459158988.154ee9daf455aa13fd742944244e6c61.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689459159183"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689459159183"}]},"ts":"1689459159183"} 2023-07-15 22:12:39,187 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-15 22:12:39,188 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-15 22:12:39,188 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689459159188"}]},"ts":"1689459159188"} 2023-07-15 22:12:39,190 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-07-15 22:12:39,195 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-15 22:12:39,197 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-15 22:12:39,197 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-15 22:12:39,197 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-15 22:12:39,197 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-15 22:12:39,197 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=4bee573cb356c57aefc56750640bc150, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=154ee9daf455aa13fd742944244e6c61, ASSIGN}] 2023-07-15 22:12:39,201 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=154ee9daf455aa13fd742944244e6c61, ASSIGN 2023-07-15 22:12:39,201 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=4bee573cb356c57aefc56750640bc150, ASSIGN 2023-07-15 22:12:39,202 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=4bee573cb356c57aefc56750640bc150, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46037,1689459063224; forceNewPlan=false, retain=false 2023-07-15 22:12:39,202 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=154ee9daf455aa13fd742944244e6c61, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37287,1689459063311; forceNewPlan=false, retain=false 2023-07-15 22:12:39,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-15 22:12:39,352 INFO [jenkins-hbase4:42893] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-15 22:12:39,356 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=4bee573cb356c57aefc56750640bc150, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:39,356 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=154ee9daf455aa13fd742944244e6c61, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:39,356 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689459158988.4bee573cb356c57aefc56750640bc150.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689459159356"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689459159356"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689459159356"}]},"ts":"1689459159356"} 2023-07-15 22:12:39,356 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689459158988.154ee9daf455aa13fd742944244e6c61.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689459159356"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689459159356"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689459159356"}]},"ts":"1689459159356"} 2023-07-15 22:12:39,359 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=92, state=RUNNABLE; OpenRegionProcedure 154ee9daf455aa13fd742944244e6c61, server=jenkins-hbase4.apache.org,37287,1689459063311}] 2023-07-15 22:12:39,365 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; OpenRegionProcedure 4bee573cb356c57aefc56750640bc150, server=jenkins-hbase4.apache.org,46037,1689459063224}] 2023-07-15 22:12:39,520 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1689459158988.154ee9daf455aa13fd742944244e6c61. 2023-07-15 22:12:39,520 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 154ee9daf455aa13fd742944244e6c61, NAME => 'testtb-testEmptyExportFileSystemState,1,1689459158988.154ee9daf455aa13fd742944244e6c61.', STARTKEY => '1', ENDKEY => ''} 2023-07-15 22:12:39,521 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1689459158988.154ee9daf455aa13fd742944244e6c61. service=AccessControlService 2023-07-15 22:12:39,521 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 22:12:39,521 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 154ee9daf455aa13fd742944244e6c61 2023-07-15 22:12:39,521 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689459158988.154ee9daf455aa13fd742944244e6c61.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 22:12:39,521 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 154ee9daf455aa13fd742944244e6c61 2023-07-15 22:12:39,521 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 154ee9daf455aa13fd742944244e6c61 2023-07-15 22:12:39,522 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1689459158988.4bee573cb356c57aefc56750640bc150. 2023-07-15 22:12:39,522 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4bee573cb356c57aefc56750640bc150, NAME => 'testtb-testEmptyExportFileSystemState,,1689459158988.4bee573cb356c57aefc56750640bc150.', STARTKEY => '', ENDKEY => '1'} 2023-07-15 22:12:39,522 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1689459158988.4bee573cb356c57aefc56750640bc150. service=AccessControlService 2023-07-15 22:12:39,522 INFO [StoreOpener-154ee9daf455aa13fd742944244e6c61-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 154ee9daf455aa13fd742944244e6c61 2023-07-15 22:12:39,522 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 22:12:39,523 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 4bee573cb356c57aefc56750640bc150 2023-07-15 22:12:39,523 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689459158988.4bee573cb356c57aefc56750640bc150.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 22:12:39,523 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 4bee573cb356c57aefc56750640bc150 2023-07-15 22:12:39,523 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 4bee573cb356c57aefc56750640bc150 2023-07-15 22:12:39,524 DEBUG [StoreOpener-154ee9daf455aa13fd742944244e6c61-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testEmptyExportFileSystemState/154ee9daf455aa13fd742944244e6c61/cf 2023-07-15 22:12:39,524 DEBUG [StoreOpener-154ee9daf455aa13fd742944244e6c61-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testEmptyExportFileSystemState/154ee9daf455aa13fd742944244e6c61/cf 2023-07-15 22:12:39,525 INFO [StoreOpener-154ee9daf455aa13fd742944244e6c61-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 154ee9daf455aa13fd742944244e6c61 columnFamilyName cf 2023-07-15 22:12:39,525 INFO [StoreOpener-154ee9daf455aa13fd742944244e6c61-1] regionserver.HStore(310): Store=154ee9daf455aa13fd742944244e6c61/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 22:12:39,528 INFO [StoreOpener-4bee573cb356c57aefc56750640bc150-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 4bee573cb356c57aefc56750640bc150 2023-07-15 22:12:39,528 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testEmptyExportFileSystemState/154ee9daf455aa13fd742944244e6c61 2023-07-15 22:12:39,529 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testEmptyExportFileSystemState/154ee9daf455aa13fd742944244e6c61 2023-07-15 22:12:39,532 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 154ee9daf455aa13fd742944244e6c61 2023-07-15 22:12:39,532 DEBUG [StoreOpener-4bee573cb356c57aefc56750640bc150-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testEmptyExportFileSystemState/4bee573cb356c57aefc56750640bc150/cf 2023-07-15 22:12:39,533 DEBUG [StoreOpener-4bee573cb356c57aefc56750640bc150-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testEmptyExportFileSystemState/4bee573cb356c57aefc56750640bc150/cf 2023-07-15 22:12:39,533 INFO [StoreOpener-4bee573cb356c57aefc56750640bc150-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4bee573cb356c57aefc56750640bc150 columnFamilyName cf 2023-07-15 22:12:39,534 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testEmptyExportFileSystemState/154ee9daf455aa13fd742944244e6c61/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 22:12:39,534 INFO [StoreOpener-4bee573cb356c57aefc56750640bc150-1] regionserver.HStore(310): Store=4bee573cb356c57aefc56750640bc150/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 22:12:39,534 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 154ee9daf455aa13fd742944244e6c61; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72399053, jitterRate=0.07882995903491974}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 22:12:39,534 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 154ee9daf455aa13fd742944244e6c61: 2023-07-15 22:12:39,536 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testEmptyExportFileSystemState/4bee573cb356c57aefc56750640bc150 2023-07-15 22:12:39,537 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testEmptyExportFileSystemState/4bee573cb356c57aefc56750640bc150 2023-07-15 22:12:39,540 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 4bee573cb356c57aefc56750640bc150 2023-07-15 22:12:39,541 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1689459158988.154ee9daf455aa13fd742944244e6c61., pid=93, masterSystemTime=1689459159517 2023-07-15 22:12:39,542 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testEmptyExportFileSystemState/4bee573cb356c57aefc56750640bc150/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 22:12:39,542 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 4bee573cb356c57aefc56750640bc150; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66433466, jitterRate=-0.01006421446800232}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 22:12:39,542 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 4bee573cb356c57aefc56750640bc150: 2023-07-15 22:12:39,543 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1689459158988.154ee9daf455aa13fd742944244e6c61. 2023-07-15 22:12:39,543 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1689459158988.4bee573cb356c57aefc56750640bc150., pid=94, masterSystemTime=1689459159519 2023-07-15 22:12:39,543 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1689459158988.154ee9daf455aa13fd742944244e6c61. 2023-07-15 22:12:39,544 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=154ee9daf455aa13fd742944244e6c61, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:39,544 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1689459158988.154ee9daf455aa13fd742944244e6c61.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689459159544"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689459159544"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689459159544"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689459159544"}]},"ts":"1689459159544"} 2023-07-15 22:12:39,547 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1689459158988.4bee573cb356c57aefc56750640bc150. 2023-07-15 22:12:39,547 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1689459158988.4bee573cb356c57aefc56750640bc150. 2023-07-15 22:12:39,547 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=4bee573cb356c57aefc56750640bc150, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:39,547 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1689459158988.4bee573cb356c57aefc56750640bc150.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689459159547"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689459159547"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689459159547"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689459159547"}]},"ts":"1689459159547"} 2023-07-15 22:12:39,548 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=92 2023-07-15 22:12:39,548 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=92, state=SUCCESS; OpenRegionProcedure 154ee9daf455aa13fd742944244e6c61, server=jenkins-hbase4.apache.org,37287,1689459063311 in 187 msec 2023-07-15 22:12:39,549 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=154ee9daf455aa13fd742944244e6c61, ASSIGN in 351 msec 2023-07-15 22:12:39,551 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=91 2023-07-15 22:12:39,551 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=91, state=SUCCESS; OpenRegionProcedure 4bee573cb356c57aefc56750640bc150, server=jenkins-hbase4.apache.org,46037,1689459063224 in 183 msec 2023-07-15 22:12:39,552 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=91, resume processing ppid=90 2023-07-15 22:12:39,553 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=4bee573cb356c57aefc56750640bc150, ASSIGN in 354 msec 2023-07-15 22:12:39,553 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-15 22:12:39,553 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689459159553"}]},"ts":"1689459159553"} 2023-07-15 22:12:39,554 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-07-15 22:12:39,557 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-15 22:12:39,557 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-07-15 22:12:39,558 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38193] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-15 22:12:39,560 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 22:12:39,560 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 22:12:39,560 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 22:12:39,560 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 22:12:39,563 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-15 22:12:39,563 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-15 22:12:39,563 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-15 22:12:39,563 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-15 22:12:39,565 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-15 22:12:39,565 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-15 22:12:39,565 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-15 22:12:39,565 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-15 22:12:39,565 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 576 msec 2023-07-15 22:12:39,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-15 22:12:39,613 INFO [Listener at jenkins-hbase4.apache.org/46535] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-07-15 22:12:39,613 DEBUG [Listener at jenkins-hbase4.apache.org/46535] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testEmptyExportFileSystemState get assigned. Timeout = 60000ms 2023-07-15 22:12:39,614 INFO [Listener at jenkins-hbase4.apache.org/46535] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 22:12:39,622 INFO [Listener at jenkins-hbase4.apache.org/46535] hbase.HBaseTestingUtility(3484): All regions for table testtb-testEmptyExportFileSystemState assigned to meta. Checking AM states. 2023-07-15 22:12:39,622 INFO [Listener at jenkins-hbase4.apache.org/46535] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 22:12:39,623 INFO [Listener at jenkins-hbase4.apache.org/46535] hbase.HBaseTestingUtility(3504): All regions for table testtb-testEmptyExportFileSystemState assigned. 2023-07-15 22:12:39,627 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-15 22:12:39,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689459159628 (current time:1689459159628). 2023-07-15 22:12:39,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 22:12:39,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] zookeeper.ReadOnlyZKClient(139): Connect 0x0adb3c0c to 127.0.0.1:53678 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 22:12:39,638 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@13c81a2e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 22:12:39,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 22:12:39,645 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49580, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 22:12:39,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0adb3c0c to 127.0.0.1:53678 2023-07-15 22:12:39,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 22:12:39,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] zookeeper.ReadOnlyZKClient(139): Connect 0x6203223a to 127.0.0.1:53678 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 22:12:39,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@31eb592a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 22:12:39,699 DEBUG [hconnection-0x62212c53-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 22:12:39,700 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49590, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 22:12:39,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6203223a to 127.0.0.1:53678 2023-07-15 22:12:39,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 22:12:39,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-15 22:12:39,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 22:12:39,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-15 22:12:39,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-15 22:12:39,719 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-15 22:12:39,723 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689459759723 2023-07-15 22:12:39,723 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-15 22:12:39,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-15 22:12:39,726 DEBUG [Listener at jenkins-hbase4.apache.org/46535] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 22:12:39,726 DEBUG [Listener at jenkins-hbase4.apache.org/46535] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 22:12:39,731 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-15 22:12:39,731 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-15 22:12:39,734 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 16 msec 2023-07-15 22:12:39,738 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-15 22:12:39,739 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689459759739 2023-07-15 22:12:39,827 DEBUG [Listener at jenkins-hbase4.apache.org/46535] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 22:12:39,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-15 22:12:39,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-15 22:12:39,833 DEBUG [Listener at jenkins-hbase4.apache.org/46535] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 22:12:39,859 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:39,859 INFO [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-07-15 22:12:39,859 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 22:12:39,859 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-15 22:12:39,859 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-15 22:12:39,860 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:39,860 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:39,865 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:12:39,865 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:12:39,865 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:12:39,865 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:12:39,865 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:12:39,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:12:39,865 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:12:39,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:12:39,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:12:39,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:39,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:39,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:39,866 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:39,866 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:39,871 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:39,871 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:39,871 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:39,871 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:39,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-15 22:12:39,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:39,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-15 22:12:39,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:39,871 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-15 22:12:39,871 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-15 22:12:39,872 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:39,872 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 22:12:39,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-15 22:12:39,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:39,872 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-15 22:12:39,877 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:39,877 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:39,877 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-15 22:12:39,877 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 22:12:39,877 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-15 22:12:39,877 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 22:12:39,880 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:39,880 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-15 22:12:39,881 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-15 22:12:39,881 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46037,1689459063224' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-15 22:12:39,880 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-15 22:12:39,881 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 22:12:39,880 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-15 22:12:39,882 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-15 22:12:39,883 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38193,1689459063370' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-15 22:12:39,882 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-15 22:12:39,883 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-15 22:12:39,883 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37287,1689459063311' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-15 22:12:39,884 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:39,884 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:39,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:39,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:12:39,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:12:39,887 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:39,887 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:39,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:12:39,887 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:39,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:12:39,888 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:39,888 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 22:12:39,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:39,889 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:39,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:12:39,889 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:39,889 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 22:12:39,889 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 22:12:39,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:39,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:39,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:12:39,890 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46037,1689459063224' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-15 22:12:39,890 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@641f7658[Count = 1] remaining members to acquire global barrier 2023-07-15 22:12:39,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:39,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:12:39,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:12:39,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:12:39,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:12:39,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:39,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:12:39,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:39,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:39,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:12:39,894 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37287,1689459063311' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-15 22:12:39,894 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@641f7658[Count = 0] remaining members to acquire global barrier 2023-07-15 22:12:39,894 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-15 22:12:39,894 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:39,895 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:39,896 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:39,896 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:39,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:39,896 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-15 22:12:39,896 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:39,896 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 22:12:39,896 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 22:12:39,896 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:39,896 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:39,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:39,896 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-15 22:12:39,896 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:39,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:39,897 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-15 22:12:39,897 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-15 22:12:39,897 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,38193,1689459063370' in zk 2023-07-15 22:12:39,897 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:39,897 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 22:12:39,897 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 22:12:39,897 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 22:12:39,897 DEBUG [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689459158988.4bee573cb356c57aefc56750640bc150. 2023-07-15 22:12:39,897 DEBUG [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689459158988.4bee573cb356c57aefc56750640bc150. started... 2023-07-15 22:12:39,899 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-15 22:12:39,899 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 22:12:39,899 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-15 22:12:39,901 DEBUG [rs(jenkins-hbase4.apache.org,37287,1689459063311)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689459158988.154ee9daf455aa13fd742944244e6c61. 2023-07-15 22:12:39,901 DEBUG [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4bee573cb356c57aefc56750640bc150: 2023-07-15 22:12:39,901 DEBUG [rs(jenkins-hbase4.apache.org,37287,1689459063311)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689459158988.154ee9daf455aa13fd742944244e6c61. started... 2023-07-15 22:12:39,902 DEBUG [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689459158988.4bee573cb356c57aefc56750640bc150.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:39,902 DEBUG [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 22:12:39,902 DEBUG [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-15 22:12:39,904 DEBUG [rs(jenkins-hbase4.apache.org,37287,1689459063311)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 154ee9daf455aa13fd742944244e6c61: 2023-07-15 22:12:39,904 DEBUG [rs(jenkins-hbase4.apache.org,37287,1689459063311)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689459158988.154ee9daf455aa13fd742944244e6c61.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:39,904 DEBUG [rs(jenkins-hbase4.apache.org,37287,1689459063311)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 22:12:39,904 DEBUG [rs(jenkins-hbase4.apache.org,37287,1689459063311)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-15 22:12:39,947 DEBUG [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689459158988.4bee573cb356c57aefc56750640bc150. completed. 2023-07-15 22:12:39,947 DEBUG [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689459158988.4bee573cb356c57aefc56750640bc150. 2023-07-15 22:12:39,947 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 22:12:39,947 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 22:12:39,947 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:39,947 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-15 22:12:39,947 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,46037,1689459063224' in zk 2023-07-15 22:12:39,949 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:39,949 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-15 22:12:39,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:39,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:12:39,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:12:39,949 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 22:12:39,950 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-15 22:12:39,954 DEBUG [rs(jenkins-hbase4.apache.org,37287,1689459063311)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689459158988.154ee9daf455aa13fd742944244e6c61. completed. 2023-07-15 22:12:39,954 DEBUG [rs(jenkins-hbase4.apache.org,37287,1689459063311)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689459158988.154ee9daf455aa13fd742944244e6c61. 2023-07-15 22:12:39,955 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 22:12:39,955 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 22:12:39,955 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:39,955 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-15 22:12:39,955 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37287,1689459063311' in zk 2023-07-15 22:12:39,956 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:39,957 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-15 22:12:39,957 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 22:12:39,957 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-15 22:12:39,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:12:39,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:12:39,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:39,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:12:39,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:39,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:39,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:12:39,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:39,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:12:39,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:39,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:39,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,46037,1689459063224': 2023-07-15 22:12:39,971 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46037,1689459063224' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-15 22:12:39,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:39,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:12:39,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:12:39,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:12:39,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:12:39,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:39,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:12:39,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:39,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:39,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:12:39,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:39,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:12:39,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:39,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:39,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,37287,1689459063311': 2023-07-15 22:12:39,976 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37287,1689459063311' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-15 22:12:39,976 INFO [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-07-15 22:12:39,976 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 22:12:39,976 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 22:12:39,976 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:39,976 INFO [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 22:12:39,979 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:39,979 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:12:39,979 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:39,979 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:39,979 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:39,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:39,979 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:39,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:39,979 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:39,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:39,979 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:39,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:39,979 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:12:39,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:12:39,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:12:39,979 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:12:39,980 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:12:39,980 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:12:39,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:12:39,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:12:39,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:39,980 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:12:39,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:12:39,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:12:39,980 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:12:39,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:12:39,980 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:39,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:39,982 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:39,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:39,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:12:39,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:39,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:39,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:12:39,984 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:12:39,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:39,984 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:39,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:39,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:39,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:12:39,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:39,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:39,990 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:40,001 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:40,001 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:40,001 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:40,001 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:12:40,001 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:12:40,001 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 22:12:40,001 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:12:40,001 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:12:40,001 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:12:40,001 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:12:40,003 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:12:40,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:12:40,003 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:40,003 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:12:40,003 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:40,004 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:40,004 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:12:40,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:12:40,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:12:40,001 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:12:40,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:12:40,001 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:12:40,003 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:40,004 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:40,004 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:40,004 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:12:40,004 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:40,004 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:40,004 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:12:40,005 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:12:40,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:12:40,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:12:40,004 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:40,034 DEBUG [Listener at jenkins-hbase4.apache.org/46535] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 22:12:40,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-15 22:12:40,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-15 22:12:40,035 DEBUG [Listener at jenkins-hbase4.apache.org/46535] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-15 22:12:40,085 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:40,107 WARN [DataStreamer for file /user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo] hdfs.DataStreamer(982): Caught exception java.lang.InterruptedException at java.lang.Object.wait(Native Method) at java.lang.Thread.join(Thread.java:1257) at java.lang.Thread.join(Thread.java:1331) at org.apache.hadoop.hdfs.DataStreamer.closeResponder(DataStreamer.java:980) at org.apache.hadoop.hdfs.DataStreamer.endBlock(DataStreamer.java:630) at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:807) 2023-07-15 22:12:40,130 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-15 22:12:40,130 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:40,130 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:40,130 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689459159723Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689459160004 (+281 ms)Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1689459160004Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1689459160039 (+35 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689459160072 (+33 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689459160130 (+58 ms) 2023-07-15 22:12:40,135 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-15 22:12:40,140 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 410 msec 2023-07-15 22:12:40,335 DEBUG [Listener at jenkins-hbase4.apache.org/46535] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 22:12:40,336 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-15 22:12:40,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 22:12:40,353 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46037] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1689459158988.4bee573cb356c57aefc56750640bc150. with WAL disabled. Data may be lost in the event of a crash. 2023-07-15 22:12:40,354 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37287] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1689459158988.154ee9daf455aa13fd742944244e6c61. with WAL disabled. Data may be lost in the event of a crash. 2023-07-15 22:12:40,364 DEBUG [Listener at jenkins-hbase4.apache.org/46535] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-15 22:12:40,365 DEBUG [Listener at jenkins-hbase4.apache.org/46535] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689459158988.4bee573cb356c57aefc56750640bc150. 2023-07-15 22:12:40,365 INFO [Listener at jenkins-hbase4.apache.org/46535] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 22:12:40,385 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-15 22:12:40,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689459160385 (current time:1689459160385). 2023-07-15 22:12:40,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 22:12:40,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] zookeeper.ReadOnlyZKClient(139): Connect 0x36f94d6f to 127.0.0.1:53678 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 22:12:40,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5d51bc57, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 22:12:40,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 22:12:40,413 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53388, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 22:12:40,419 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x36f94d6f to 127.0.0.1:53678 2023-07-15 22:12:40,419 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 22:12:40,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] zookeeper.ReadOnlyZKClient(139): Connect 0x69ac14e7 to 127.0.0.1:53678 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 22:12:40,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@15c2be88, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 22:12:40,557 DEBUG [hconnection-0x45211b63-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 22:12:40,562 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53402, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 22:12:40,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x69ac14e7 to 127.0.0.1:53678 2023-07-15 22:12:40,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 22:12:40,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-15 22:12:40,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 22:12:40,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-15 22:12:40,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-15 22:12:40,579 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-15 22:12:40,580 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689459760580 2023-07-15 22:12:40,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-15 22:12:40,580 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-15 22:12:40,582 DEBUG [Listener at jenkins-hbase4.apache.org/46535] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 22:12:40,582 DEBUG [Listener at jenkins-hbase4.apache.org/46535] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 22:12:40,584 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-15 22:12:40,584 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-15 22:12:40,589 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 9 msec 2023-07-15 22:12:40,591 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-15 22:12:40,592 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689459760592 2023-07-15 22:12:40,683 DEBUG [Listener at jenkins-hbase4.apache.org/46535] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 22:12:40,684 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-15 22:12:40,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-15 22:12:40,687 DEBUG [Listener at jenkins-hbase4.apache.org/46535] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 22:12:40,690 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:40,690 INFO [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-07-15 22:12:40,690 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 22:12:40,690 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-15 22:12:40,690 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-15 22:12:40,691 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:40,691 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:40,692 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:12:40,692 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:12:40,692 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:12:40,692 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:40,692 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:12:40,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:12:40,692 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:12:40,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:12:40,692 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:12:40,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:12:40,693 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:40,693 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:40,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:40,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:40,693 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:40,693 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 22:12:40,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:40,694 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:40,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-15 22:12:40,694 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:40,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:40,694 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-15 22:12:40,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-15 22:12:40,694 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:40,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:40,695 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-15 22:12:40,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-15 22:12:40,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:40,695 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-15 22:12:40,698 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:40,699 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-15 22:12:40,699 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 22:12:40,702 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:40,702 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-15 22:12:40,702 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 22:12:40,705 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:40,707 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-15 22:12:40,707 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-15 22:12:40,707 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46037,1689459063224' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-15 22:12:40,707 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-15 22:12:40,707 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-15 22:12:40,707 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38193,1689459063370' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-15 22:12:40,710 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-15 22:12:40,710 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 22:12:40,715 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-15 22:12:40,715 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-15 22:12:40,715 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37287,1689459063311' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-15 22:12:40,721 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:40,722 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:40,722 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:40,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:40,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:12:40,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:12:40,722 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:40,722 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 22:12:40,722 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:40,722 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 22:12:40,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:12:40,725 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:40,725 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:40,725 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 22:12:40,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:12:40,725 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:40,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:40,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:12:40,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:40,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:40,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:12:40,728 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46037,1689459063224' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-15 22:12:40,728 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@314fb633[Count = 1] remaining members to acquire global barrier 2023-07-15 22:12:40,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:40,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:12:40,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:12:40,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:12:40,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:12:40,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:40,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:12:40,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:40,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:40,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:12:40,731 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37287,1689459063311' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-15 22:12:40,731 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@314fb633[Count = 0] remaining members to acquire global barrier 2023-07-15 22:12:40,731 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-15 22:12:40,731 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:40,735 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:40,735 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:40,735 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:40,735 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:40,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:40,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:40,735 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-15 22:12:40,735 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-15 22:12:40,735 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,38193,1689459063370' in zk 2023-07-15 22:12:40,735 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:40,735 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-15 22:12:40,735 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:40,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:40,736 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-15 22:12:40,736 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 22:12:40,736 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 22:12:40,737 DEBUG [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689459158988.4bee573cb356c57aefc56750640bc150. 2023-07-15 22:12:40,737 DEBUG [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689459158988.4bee573cb356c57aefc56750640bc150. started... 2023-07-15 22:12:40,737 INFO [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 4bee573cb356c57aefc56750640bc150 1/1 column families, dataSize=333 B heapSize=976 B 2023-07-15 22:12:40,741 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 22:12:40,741 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 22:12:40,741 DEBUG [rs(jenkins-hbase4.apache.org,37287,1689459063311)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689459158988.154ee9daf455aa13fd742944244e6c61. 2023-07-15 22:12:40,741 DEBUG [rs(jenkins-hbase4.apache.org,37287,1689459063311)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689459158988.154ee9daf455aa13fd742944244e6c61. started... 2023-07-15 22:12:40,741 INFO [rs(jenkins-hbase4.apache.org,37287,1689459063311)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 154ee9daf455aa13fd742944244e6c61 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-07-15 22:12:40,743 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-15 22:12:40,743 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 22:12:40,743 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-15 22:12:40,743 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:40,745 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:40,745 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 22:12:40,819 INFO [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=333 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testEmptyExportFileSystemState/4bee573cb356c57aefc56750640bc150/.tmp/cf/1a5219183c074495911192b77e980dee 2023-07-15 22:12:40,827 DEBUG [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testEmptyExportFileSystemState/4bee573cb356c57aefc56750640bc150/.tmp/cf/1a5219183c074495911192b77e980dee as hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testEmptyExportFileSystemState/4bee573cb356c57aefc56750640bc150/cf/1a5219183c074495911192b77e980dee 2023-07-15 22:12:40,831 INFO [rs(jenkins-hbase4.apache.org,37287,1689459063311)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.93 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testEmptyExportFileSystemState/154ee9daf455aa13fd742944244e6c61/.tmp/cf/cb26e0239a134244ae76845c62894c9e 2023-07-15 22:12:40,834 INFO [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testEmptyExportFileSystemState/4bee573cb356c57aefc56750640bc150/cf/1a5219183c074495911192b77e980dee, entries=5, sequenceid=6, filesize=5.2 K 2023-07-15 22:12:40,835 INFO [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 4bee573cb356c57aefc56750640bc150 in 98ms, sequenceid=6, compaction requested=false 2023-07-15 22:12:40,835 DEBUG [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-15 22:12:40,836 DEBUG [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4bee573cb356c57aefc56750640bc150: 2023-07-15 22:12:40,836 DEBUG [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689459158988.4bee573cb356c57aefc56750640bc150.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:40,836 DEBUG [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 22:12:40,836 DEBUG [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testEmptyExportFileSystemState/4bee573cb356c57aefc56750640bc150/cf/1a5219183c074495911192b77e980dee] hfiles 2023-07-15 22:12:40,836 DEBUG [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testEmptyExportFileSystemState/4bee573cb356c57aefc56750640bc150/cf/1a5219183c074495911192b77e980dee for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:40,840 DEBUG [rs(jenkins-hbase4.apache.org,37287,1689459063311)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testEmptyExportFileSystemState/154ee9daf455aa13fd742944244e6c61/.tmp/cf/cb26e0239a134244ae76845c62894c9e as hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testEmptyExportFileSystemState/154ee9daf455aa13fd742944244e6c61/cf/cb26e0239a134244ae76845c62894c9e 2023-07-15 22:12:40,846 INFO [rs(jenkins-hbase4.apache.org,37287,1689459063311)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testEmptyExportFileSystemState/154ee9daf455aa13fd742944244e6c61/cf/cb26e0239a134244ae76845c62894c9e, entries=45, sequenceid=6, filesize=7.9 K 2023-07-15 22:12:40,847 INFO [rs(jenkins-hbase4.apache.org,37287,1689459063311)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for 154ee9daf455aa13fd742944244e6c61 in 106ms, sequenceid=6, compaction requested=false 2023-07-15 22:12:40,849 DEBUG [rs(jenkins-hbase4.apache.org,37287,1689459063311)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 154ee9daf455aa13fd742944244e6c61: 2023-07-15 22:12:40,849 DEBUG [rs(jenkins-hbase4.apache.org,37287,1689459063311)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689459158988.154ee9daf455aa13fd742944244e6c61.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:40,850 DEBUG [rs(jenkins-hbase4.apache.org,37287,1689459063311)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 22:12:40,850 DEBUG [rs(jenkins-hbase4.apache.org,37287,1689459063311)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testEmptyExportFileSystemState/154ee9daf455aa13fd742944244e6c61/cf/cb26e0239a134244ae76845c62894c9e] hfiles 2023-07-15 22:12:40,850 DEBUG [rs(jenkins-hbase4.apache.org,37287,1689459063311)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testEmptyExportFileSystemState/154ee9daf455aa13fd742944244e6c61/cf/cb26e0239a134244ae76845c62894c9e for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:40,879 DEBUG [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689459158988.4bee573cb356c57aefc56750640bc150. completed. 2023-07-15 22:12:40,879 DEBUG [rs(jenkins-hbase4.apache.org,46037,1689459063224)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689459158988.4bee573cb356c57aefc56750640bc150. 2023-07-15 22:12:40,879 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 22:12:40,879 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 22:12:40,879 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:40,879 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-15 22:12:40,879 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,46037,1689459063224' in zk 2023-07-15 22:12:40,883 DEBUG [rs(jenkins-hbase4.apache.org,37287,1689459063311)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689459158988.154ee9daf455aa13fd742944244e6c61. completed. 2023-07-15 22:12:40,883 DEBUG [rs(jenkins-hbase4.apache.org,37287,1689459063311)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689459158988.154ee9daf455aa13fd742944244e6c61. 2023-07-15 22:12:40,883 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 22:12:40,883 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 22:12:40,883 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:40,883 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-15 22:12:40,883 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37287,1689459063311' in zk 2023-07-15 22:12:40,887 DEBUG [Listener at jenkins-hbase4.apache.org/46535] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 22:12:40,888 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-15 22:12:40,888 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-15 22:12:40,888 DEBUG [Listener at jenkins-hbase4.apache.org/46535] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-15 22:12:40,933 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:40,933 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-15 22:12:40,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:40,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:12:40,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:12:40,933 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 22:12:40,933 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-15 22:12:40,995 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-15 22:12:40,995 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:40,995 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 22:12:40,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:12:40,995 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-15 22:12:40,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:12:40,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:40,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:12:40,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:40,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:40,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:12:41,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:41,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:12:41,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:41,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:41,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,46037,1689459063224': 2023-07-15 22:12:41,001 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46037,1689459063224' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-15 22:12:41,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:41,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:12:41,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:12:41,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:12:41,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:12:41,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:41,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:12:41,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:41,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:41,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:12:41,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:41,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:12:41,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:41,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:41,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,37287,1689459063311': 2023-07-15 22:12:41,006 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37287,1689459063311' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-15 22:12:41,006 INFO [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-07-15 22:12:41,006 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 22:12:41,006 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 22:12:41,006 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:41,006 INFO [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 22:12:41,018 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:41,018 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:12:41,018 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:41,018 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:41,018 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:41,018 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:41,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:41,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:12:41,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:12:41,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:41,018 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:41,018 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:12:41,018 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:41,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:41,018 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:12:41,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:41,022 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:12:41,022 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:12:41,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:12:41,022 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:12:41,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:12:41,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:12:41,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:12:41,022 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:12:41,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:41,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:41,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:41,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:41,023 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:41,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:12:41,024 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:41,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:41,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:12:41,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:41,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:41,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:12:41,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:41,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:12:41,027 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:12:41,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:41,028 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:41,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:41,028 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:41,033 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:41,033 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:12:41,033 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:41,033 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:12:41,033 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 22:12:41,033 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:12:41,033 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:41,041 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:41,041 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:12:41,033 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:12:41,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:12:41,041 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:12:41,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:12:41,033 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:41,041 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:12:41,041 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:41,041 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:41,041 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:41,041 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:41,041 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:12:41,041 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:41,041 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:41,036 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:12:41,042 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:12:41,042 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:12:41,042 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:12:41,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:12:41,043 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:12:41,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:12:41,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:12:41,043 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:41,044 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:12:41,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:12:41,101 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:41,138 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-15 22:12:41,138 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:41,139 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:41,139 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689459160580Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1689459161041 (+461 ms)Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1689459161041Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1689459161058 (+17 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1689459161089 (+31 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689459161138 (+49 ms) 2023-07-15 22:12:41,142 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-15 22:12:41,144 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 560 msec 2023-07-15 22:12:41,189 DEBUG [Listener at jenkins-hbase4.apache.org/46535] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 22:12:41,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-15 22:12:41,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 22:12:41,190 INFO [Listener at jenkins-hbase4.apache.org/46535] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/export-test/export-1689459161190 2023-07-15 22:12:41,191 INFO [Listener at jenkins-hbase4.apache.org/46535] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:33847, tgtDir=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/export-test/export-1689459161190, rawTgtDir=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/export-test/export-1689459161190, srcFsUri=hdfs://localhost:33847, srcDir=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e 2023-07-15 22:12:41,232 DEBUG [Listener at jenkins-hbase4.apache.org/46535] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:33847, inputRoot=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e 2023-07-15 22:12:41,232 DEBUG [Listener at jenkins-hbase4.apache.org/46535] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_449179655_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/export-test/export-1689459161190, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/export-test/export-1689459161190/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:41,233 INFO [Listener at jenkins-hbase4.apache.org/46535] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:33847, inputRoot=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e, snapshotDir=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-07-15 22:12:41,271 INFO [Listener at jenkins-hbase4.apache.org/46535] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/export-test/export-1689459161190/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:41,376 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-15 22:12:41,377 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-15 22:12:41,377 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-15 22:12:41,378 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-15 22:12:41,378 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-15 22:12:41,379 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-15 22:12:41,379 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-15 22:12:41,472 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97e758c6-fe86-0ed9-092f-cd0594d33e04/hadoop-8427783945279119241.jar 2023-07-15 22:12:41,472 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-15 22:12:41,473 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-15 22:12:41,473 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-15 22:12:41,473 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-15 22:12:41,474 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-15 22:12:41,474 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-15 22:12:41,474 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-15 22:12:41,475 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-15 22:12:41,475 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-15 22:12:41,476 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-15 22:12:41,476 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-15 22:12:41,476 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-15 22:12:41,477 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-15 22:12:41,477 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-15 22:12:41,477 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-15 22:12:41,478 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-15 22:12:41,478 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 22:12:41,479 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 22:12:41,479 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 22:12:41,480 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 22:12:41,480 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 22:12:41,480 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 22:12:41,481 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 22:12:42,239 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689459070788_0005_000001 (auth:SIMPLE) 2023-07-15 22:12:42,706 WARN [Listener at jenkins-hbase4.apache.org/46535] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-15 22:12:42,708 INFO [Listener at jenkins-hbase4.apache.org/46535] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-07-15 22:12:42,803 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 22:12:42,803 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 22:12:42,927 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689459070788_0006_000001 (auth:SIMPLE) 2023-07-15 22:12:43,847 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-15 22:12:48,259 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689459070788_0006_000001 (auth:SIMPLE) 2023-07-15 22:12:51,125 INFO [Listener at jenkins-hbase4.apache.org/46535] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-15 22:12:51,126 INFO [Listener at jenkins-hbase4.apache.org/46535] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-15 22:12:51,138 INFO [Listener at jenkins-hbase4.apache.org/46535] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:51,139 INFO [Listener at jenkins-hbase4.apache.org/46535] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-15 22:12:51,139 INFO [Listener at jenkins-hbase4.apache.org/46535] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-15 22:12:51,140 DEBUG [Listener at jenkins-hbase4.apache.org/46535] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2077448059_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:51,141 DEBUG [Listener at jenkins-hbase4.apache.org/46535] snapshot.TestExportSnapshot(367): hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-15 22:12:51,141 DEBUG [Listener at jenkins-hbase4.apache.org/46535] snapshot.TestExportSnapshot(367): hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-15 22:12:51,141 DEBUG [Listener at jenkins-hbase4.apache.org/46535] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2077448059_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/export-test/export-1689459161190/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/export-test/export-1689459161190/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:51,142 DEBUG [Listener at jenkins-hbase4.apache.org/46535] snapshot.TestExportSnapshot(367): hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/export-test/export-1689459161190/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-15 22:12:51,142 DEBUG [Listener at jenkins-hbase4.apache.org/46535] snapshot.TestExportSnapshot(367): hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/export-test/export-1689459161190/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-15 22:12:51,152 INFO [Listener at jenkins-hbase4.apache.org/46535] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-07-15 22:12:51,152 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-07-15 22:12:51,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] procedure2.ProcedureExecutor(1029): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-15 22:12:51,157 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-15 22:12:51,158 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689459171158"}]},"ts":"1689459171158"} 2023-07-15 22:12:51,159 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-07-15 22:12:51,161 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-07-15 22:12:51,162 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=4bee573cb356c57aefc56750640bc150, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=154ee9daf455aa13fd742944244e6c61, UNASSIGN}] 2023-07-15 22:12:51,168 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=4bee573cb356c57aefc56750640bc150, UNASSIGN 2023-07-15 22:12:51,168 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=154ee9daf455aa13fd742944244e6c61, UNASSIGN 2023-07-15 22:12:51,169 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=154ee9daf455aa13fd742944244e6c61, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:51,169 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=4bee573cb356c57aefc56750640bc150, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:51,169 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689459158988.154ee9daf455aa13fd742944244e6c61.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689459171169"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689459171169"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689459171169"}]},"ts":"1689459171169"} 2023-07-15 22:12:51,169 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689459158988.4bee573cb356c57aefc56750640bc150.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689459171169"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689459171169"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689459171169"}]},"ts":"1689459171169"} 2023-07-15 22:12:51,171 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=101, state=RUNNABLE; CloseRegionProcedure 154ee9daf455aa13fd742944244e6c61, server=jenkins-hbase4.apache.org,37287,1689459063311}] 2023-07-15 22:12:51,172 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=100, state=RUNNABLE; CloseRegionProcedure 4bee573cb356c57aefc56750640bc150, server=jenkins-hbase4.apache.org,46037,1689459063224}] 2023-07-15 22:12:51,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-15 22:12:51,324 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 154ee9daf455aa13fd742944244e6c61 2023-07-15 22:12:51,324 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 154ee9daf455aa13fd742944244e6c61, disabling compactions & flushes 2023-07-15 22:12:51,324 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689459158988.154ee9daf455aa13fd742944244e6c61. 2023-07-15 22:12:51,324 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689459158988.154ee9daf455aa13fd742944244e6c61. 2023-07-15 22:12:51,324 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689459158988.154ee9daf455aa13fd742944244e6c61. after waiting 0 ms 2023-07-15 22:12:51,324 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689459158988.154ee9daf455aa13fd742944244e6c61. 2023-07-15 22:12:51,335 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 4bee573cb356c57aefc56750640bc150 2023-07-15 22:12:51,335 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 4bee573cb356c57aefc56750640bc150, disabling compactions & flushes 2023-07-15 22:12:51,335 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689459158988.4bee573cb356c57aefc56750640bc150. 2023-07-15 22:12:51,335 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689459158988.4bee573cb356c57aefc56750640bc150. 2023-07-15 22:12:51,335 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689459158988.4bee573cb356c57aefc56750640bc150. after waiting 0 ms 2023-07-15 22:12:51,335 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689459158988.4bee573cb356c57aefc56750640bc150. 2023-07-15 22:12:51,350 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testEmptyExportFileSystemState/154ee9daf455aa13fd742944244e6c61/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 22:12:51,351 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 22:12:51,353 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689459158988.154ee9daf455aa13fd742944244e6c61. 2023-07-15 22:12:51,353 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 154ee9daf455aa13fd742944244e6c61: 2023-07-15 22:12:51,355 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 154ee9daf455aa13fd742944244e6c61 2023-07-15 22:12:51,355 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=154ee9daf455aa13fd742944244e6c61, regionState=CLOSED 2023-07-15 22:12:51,355 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689459158988.154ee9daf455aa13fd742944244e6c61.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689459171355"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689459171355"}]},"ts":"1689459171355"} 2023-07-15 22:12:51,356 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testEmptyExportFileSystemState/4bee573cb356c57aefc56750640bc150/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 22:12:51,357 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 22:12:51,358 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689459158988.4bee573cb356c57aefc56750640bc150. 2023-07-15 22:12:51,358 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 4bee573cb356c57aefc56750640bc150: 2023-07-15 22:12:51,364 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 4bee573cb356c57aefc56750640bc150 2023-07-15 22:12:51,365 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=101 2023-07-15 22:12:51,365 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=4bee573cb356c57aefc56750640bc150, regionState=CLOSED 2023-07-15 22:12:51,365 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=101, state=SUCCESS; CloseRegionProcedure 154ee9daf455aa13fd742944244e6c61, server=jenkins-hbase4.apache.org,37287,1689459063311 in 187 msec 2023-07-15 22:12:51,365 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689459158988.4bee573cb356c57aefc56750640bc150.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689459171365"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689459171365"}]},"ts":"1689459171365"} 2023-07-15 22:12:51,372 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=154ee9daf455aa13fd742944244e6c61, UNASSIGN in 203 msec 2023-07-15 22:12:51,373 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=100 2023-07-15 22:12:51,373 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=100, state=SUCCESS; CloseRegionProcedure 4bee573cb356c57aefc56750640bc150, server=jenkins-hbase4.apache.org,46037,1689459063224 in 200 msec 2023-07-15 22:12:51,376 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=100, resume processing ppid=99 2023-07-15 22:12:51,377 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=4bee573cb356c57aefc56750640bc150, UNASSIGN in 211 msec 2023-07-15 22:12:51,379 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689459171379"}]},"ts":"1689459171379"} 2023-07-15 22:12:51,380 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-07-15 22:12:51,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-15 22:12:51,514 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-07-15 22:12:51,519 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 363 msec 2023-07-15 22:12:51,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-15 22:12:51,764 INFO [Listener at jenkins-hbase4.apache.org/46535] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-07-15 22:12:51,767 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-07-15 22:12:51,768 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-15 22:12:51,773 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-15 22:12:51,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-07-15 22:12:51,774 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-15 22:12:51,776 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38193] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-07-15 22:12:51,784 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testEmptyExportFileSystemState/154ee9daf455aa13fd742944244e6c61 2023-07-15 22:12:51,784 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testEmptyExportFileSystemState/4bee573cb356c57aefc56750640bc150 2023-07-15 22:12:51,788 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testEmptyExportFileSystemState/154ee9daf455aa13fd742944244e6c61/cf, FileablePath, hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testEmptyExportFileSystemState/154ee9daf455aa13fd742944244e6c61/recovered.edits] 2023-07-15 22:12:51,795 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testEmptyExportFileSystemState/4bee573cb356c57aefc56750640bc150/cf, FileablePath, hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testEmptyExportFileSystemState/4bee573cb356c57aefc56750640bc150/recovered.edits] 2023-07-15 22:12:51,802 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testEmptyExportFileSystemState/154ee9daf455aa13fd742944244e6c61/cf/cb26e0239a134244ae76845c62894c9e to hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/archive/data/default/testtb-testEmptyExportFileSystemState/154ee9daf455aa13fd742944244e6c61/cf/cb26e0239a134244ae76845c62894c9e 2023-07-15 22:12:51,807 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testEmptyExportFileSystemState/4bee573cb356c57aefc56750640bc150/cf/1a5219183c074495911192b77e980dee to hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/archive/data/default/testtb-testEmptyExportFileSystemState/4bee573cb356c57aefc56750640bc150/cf/1a5219183c074495911192b77e980dee 2023-07-15 22:12:51,813 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testEmptyExportFileSystemState/154ee9daf455aa13fd742944244e6c61/recovered.edits/9.seqid to hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/archive/data/default/testtb-testEmptyExportFileSystemState/154ee9daf455aa13fd742944244e6c61/recovered.edits/9.seqid 2023-07-15 22:12:51,813 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testEmptyExportFileSystemState/154ee9daf455aa13fd742944244e6c61 2023-07-15 22:12:51,815 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testEmptyExportFileSystemState/4bee573cb356c57aefc56750640bc150/recovered.edits/9.seqid to hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/archive/data/default/testtb-testEmptyExportFileSystemState/4bee573cb356c57aefc56750640bc150/recovered.edits/9.seqid 2023-07-15 22:12:51,816 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testEmptyExportFileSystemState/4bee573cb356c57aefc56750640bc150 2023-07-15 22:12:51,816 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-15 22:12:51,822 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-15 22:12:51,830 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-07-15 22:12:51,898 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-15 22:12:51,898 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-15 22:12:51,898 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-15 22:12:51,898 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-15 22:12:51,899 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-15 22:12:51,899 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-15 22:12:51,899 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-15 22:12:51,900 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-07-15 22:12:51,902 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-15 22:12:51,903 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-07-15 22:12:51,903 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1689459158988.4bee573cb356c57aefc56750640bc150.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689459171903"}]},"ts":"9223372036854775807"} 2023-07-15 22:12:51,903 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1689459158988.154ee9daf455aa13fd742944244e6c61.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689459171903"}]},"ts":"9223372036854775807"} 2023-07-15 22:12:51,906 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-15 22:12:51,906 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 4bee573cb356c57aefc56750640bc150, NAME => 'testtb-testEmptyExportFileSystemState,,1689459158988.4bee573cb356c57aefc56750640bc150.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 154ee9daf455aa13fd742944244e6c61, NAME => 'testtb-testEmptyExportFileSystemState,1,1689459158988.154ee9daf455aa13fd742944244e6c61.', STARTKEY => '1', ENDKEY => ''}] 2023-07-15 22:12:51,906 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-07-15 22:12:51,906 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689459171906"}]},"ts":"9223372036854775807"} 2023-07-15 22:12:51,908 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-07-15 22:12:52,005 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-15 22:12:52,005 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data null 2023-07-15 22:12:52,005 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-15 22:12:52,005 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 22:12:52,005 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-15 22:12:52,006 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 22:12:52,005 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-15 22:12:52,005 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 22:12:52,006 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 22:12:52,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-15 22:12:52,106 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-15 22:12:52,107 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 339 msec 2023-07-15 22:12:52,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-15 22:12:52,108 INFO [Listener at jenkins-hbase4.apache.org/46535] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-07-15 22:12:52,115 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-07-15 22:12:52,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:52,118 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-07-15 22:12:52,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-07-15 22:12:52,147 INFO [Listener at jenkins-hbase4.apache.org/46535] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testEmptyExportFileSystemState Thread=763 (was 760) Potentially hanging thread: LogDeleter #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2077448059_17 at /127.0.0.1:35562 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (905985230) connection to jenkins-hbase4.apache.org/172.31.14.131:43047 from appattempt_1689459070788_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x57410306-shared-pool-38 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2077448059_17 at /127.0.0.1:38844 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (905985230) connection to jenkins-hbase4.apache.org/172.31.14.131:35905 from appattempt_1689459070788_0005_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x57410306-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4594 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-538887912_1 at /127.0.0.1:59882 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (905985230) connection to jenkins-hbase4.apache.org/172.31.14.131:38707 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2077448059_17 at /127.0.0.1:35680 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x57410306-shared-pool-37 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x57410306-shared-pool-39 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=920 (was 907) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=578 (was 455) - SystemLoadAverage LEAK? -, ProcessCount=182 (was 185), AvailableMemoryMB=2226 (was 2945) 2023-07-15 22:12:52,148 WARN [Listener at jenkins-hbase4.apache.org/46535] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-07-15 22:12:52,172 INFO [Listener at jenkins-hbase4.apache.org/46535] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=763, OpenFileDescriptor=920, MaxFileDescriptor=60000, SystemLoadAverage=578, ProcessCount=182, AvailableMemoryMB=2222 2023-07-15 22:12:52,172 WARN [Listener at jenkins-hbase4.apache.org/46535] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-07-15 22:12:52,174 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-15 22:12:52,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:52,177 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-07-15 22:12:52,177 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-07-15 22:12:52,177 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-15 22:12:52,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-15 22:12:52,180 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/47e6a767c6362ff7cdcbc307c1e77505 2023-07-15 22:12:52,180 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/20ca2c94879b83d7b212392770ab8358 2023-07-15 22:12:52,180 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/20ca2c94879b83d7b212392770ab8358 empty. 2023-07-15 22:12:52,180 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/47e6a767c6362ff7cdcbc307c1e77505 empty. 2023-07-15 22:12:52,181 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/20ca2c94879b83d7b212392770ab8358 2023-07-15 22:12:52,181 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/47e6a767c6362ff7cdcbc307c1e77505 2023-07-15 22:12:52,181 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-15 22:12:52,191 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-07-15 22:12:52,192 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => 47e6a767c6362ff7cdcbc307c1e77505, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689459172173.47e6a767c6362ff7cdcbc307c1e77505.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp 2023-07-15 22:12:52,194 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 20ca2c94879b83d7b212392770ab8358, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689459172173.20ca2c94879b83d7b212392770ab8358.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp 2023-07-15 22:12:52,211 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689459172173.20ca2c94879b83d7b212392770ab8358.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 22:12:52,211 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 20ca2c94879b83d7b212392770ab8358, disabling compactions & flushes 2023-07-15 22:12:52,211 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689459172173.20ca2c94879b83d7b212392770ab8358. 2023-07-15 22:12:52,211 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689459172173.20ca2c94879b83d7b212392770ab8358. 2023-07-15 22:12:52,211 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689459172173.20ca2c94879b83d7b212392770ab8358. after waiting 0 ms 2023-07-15 22:12:52,211 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689459172173.20ca2c94879b83d7b212392770ab8358. 2023-07-15 22:12:52,211 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689459172173.20ca2c94879b83d7b212392770ab8358. 2023-07-15 22:12:52,211 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 20ca2c94879b83d7b212392770ab8358: 2023-07-15 22:12:52,213 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689459172173.47e6a767c6362ff7cdcbc307c1e77505.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 22:12:52,213 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing 47e6a767c6362ff7cdcbc307c1e77505, disabling compactions & flushes 2023-07-15 22:12:52,213 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689459172173.47e6a767c6362ff7cdcbc307c1e77505. 2023-07-15 22:12:52,213 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689459172173.47e6a767c6362ff7cdcbc307c1e77505. 2023-07-15 22:12:52,213 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689459172173.47e6a767c6362ff7cdcbc307c1e77505. after waiting 0 ms 2023-07-15 22:12:52,213 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689459172173.47e6a767c6362ff7cdcbc307c1e77505. 2023-07-15 22:12:52,213 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689459172173.47e6a767c6362ff7cdcbc307c1e77505. 2023-07-15 22:12:52,213 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for 47e6a767c6362ff7cdcbc307c1e77505: 2023-07-15 22:12:52,216 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-07-15 22:12:52,217 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689459172173.20ca2c94879b83d7b212392770ab8358.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689459172217"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689459172217"}]},"ts":"1689459172217"} 2023-07-15 22:12:52,217 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689459172173.47e6a767c6362ff7cdcbc307c1e77505.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689459172217"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689459172217"}]},"ts":"1689459172217"} 2023-07-15 22:12:52,220 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-15 22:12:52,221 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-15 22:12:52,221 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689459172221"}]},"ts":"1689459172221"} 2023-07-15 22:12:52,224 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-07-15 22:12:52,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-15 22:12:52,352 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-15 22:12:52,353 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-15 22:12:52,353 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-15 22:12:52,354 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-15 22:12:52,354 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-15 22:12:52,354 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=47e6a767c6362ff7cdcbc307c1e77505, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=20ca2c94879b83d7b212392770ab8358, ASSIGN}] 2023-07-15 22:12:52,357 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=20ca2c94879b83d7b212392770ab8358, ASSIGN 2023-07-15 22:12:52,358 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=47e6a767c6362ff7cdcbc307c1e77505, ASSIGN 2023-07-15 22:12:52,358 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=20ca2c94879b83d7b212392770ab8358, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37287,1689459063311; forceNewPlan=false, retain=false 2023-07-15 22:12:52,359 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=47e6a767c6362ff7cdcbc307c1e77505, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38193,1689459063370; forceNewPlan=false, retain=false 2023-07-15 22:12:52,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-15 22:12:52,511 INFO [jenkins-hbase4:42893] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-15 22:12:52,514 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=20ca2c94879b83d7b212392770ab8358, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:52,514 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=47e6a767c6362ff7cdcbc307c1e77505, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:12:52,514 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689459172173.20ca2c94879b83d7b212392770ab8358.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689459172514"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689459172514"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689459172514"}]},"ts":"1689459172514"} 2023-07-15 22:12:52,514 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689459172173.47e6a767c6362ff7cdcbc307c1e77505.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689459172514"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689459172514"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689459172514"}]},"ts":"1689459172514"} 2023-07-15 22:12:52,519 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=108, ppid=107, state=RUNNABLE; OpenRegionProcedure 20ca2c94879b83d7b212392770ab8358, server=jenkins-hbase4.apache.org,37287,1689459063311}] 2023-07-15 22:12:52,520 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=106, state=RUNNABLE; OpenRegionProcedure 47e6a767c6362ff7cdcbc307c1e77505, server=jenkins-hbase4.apache.org,38193,1689459063370}] 2023-07-15 22:12:52,681 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1689459172173.20ca2c94879b83d7b212392770ab8358. 2023-07-15 22:12:52,682 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 20ca2c94879b83d7b212392770ab8358, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689459172173.20ca2c94879b83d7b212392770ab8358.', STARTKEY => '1', ENDKEY => ''} 2023-07-15 22:12:52,682 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1689459172173.20ca2c94879b83d7b212392770ab8358. service=AccessControlService 2023-07-15 22:12:52,682 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1689459172173.47e6a767c6362ff7cdcbc307c1e77505. 2023-07-15 22:12:52,682 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 22:12:52,682 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 47e6a767c6362ff7cdcbc307c1e77505, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689459172173.47e6a767c6362ff7cdcbc307c1e77505.', STARTKEY => '', ENDKEY => '1'} 2023-07-15 22:12:52,682 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 20ca2c94879b83d7b212392770ab8358 2023-07-15 22:12:52,683 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689459172173.20ca2c94879b83d7b212392770ab8358.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 22:12:52,683 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 20ca2c94879b83d7b212392770ab8358 2023-07-15 22:12:52,683 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 20ca2c94879b83d7b212392770ab8358 2023-07-15 22:12:52,683 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1689459172173.47e6a767c6362ff7cdcbc307c1e77505. service=AccessControlService 2023-07-15 22:12:52,683 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 22:12:52,683 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 47e6a767c6362ff7cdcbc307c1e77505 2023-07-15 22:12:52,683 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689459172173.47e6a767c6362ff7cdcbc307c1e77505.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 22:12:52,683 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 47e6a767c6362ff7cdcbc307c1e77505 2023-07-15 22:12:52,683 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 47e6a767c6362ff7cdcbc307c1e77505 2023-07-15 22:12:52,686 INFO [StoreOpener-20ca2c94879b83d7b212392770ab8358-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 20ca2c94879b83d7b212392770ab8358 2023-07-15 22:12:52,686 INFO [StoreOpener-47e6a767c6362ff7cdcbc307c1e77505-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 47e6a767c6362ff7cdcbc307c1e77505 2023-07-15 22:12:52,687 DEBUG [StoreOpener-20ca2c94879b83d7b212392770ab8358-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportFileSystemStateWithSkipTmp/20ca2c94879b83d7b212392770ab8358/cf 2023-07-15 22:12:52,687 DEBUG [StoreOpener-20ca2c94879b83d7b212392770ab8358-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportFileSystemStateWithSkipTmp/20ca2c94879b83d7b212392770ab8358/cf 2023-07-15 22:12:52,688 INFO [StoreOpener-20ca2c94879b83d7b212392770ab8358-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 20ca2c94879b83d7b212392770ab8358 columnFamilyName cf 2023-07-15 22:12:52,690 DEBUG [StoreOpener-47e6a767c6362ff7cdcbc307c1e77505-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportFileSystemStateWithSkipTmp/47e6a767c6362ff7cdcbc307c1e77505/cf 2023-07-15 22:12:52,690 DEBUG [StoreOpener-47e6a767c6362ff7cdcbc307c1e77505-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportFileSystemStateWithSkipTmp/47e6a767c6362ff7cdcbc307c1e77505/cf 2023-07-15 22:12:52,691 INFO [StoreOpener-47e6a767c6362ff7cdcbc307c1e77505-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 47e6a767c6362ff7cdcbc307c1e77505 columnFamilyName cf 2023-07-15 22:12:52,692 INFO [StoreOpener-20ca2c94879b83d7b212392770ab8358-1] regionserver.HStore(310): Store=20ca2c94879b83d7b212392770ab8358/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 22:12:52,692 INFO [StoreOpener-47e6a767c6362ff7cdcbc307c1e77505-1] regionserver.HStore(310): Store=47e6a767c6362ff7cdcbc307c1e77505/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 22:12:52,693 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportFileSystemStateWithSkipTmp/47e6a767c6362ff7cdcbc307c1e77505 2023-07-15 22:12:52,693 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportFileSystemStateWithSkipTmp/47e6a767c6362ff7cdcbc307c1e77505 2023-07-15 22:12:52,694 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportFileSystemStateWithSkipTmp/20ca2c94879b83d7b212392770ab8358 2023-07-15 22:12:52,694 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportFileSystemStateWithSkipTmp/20ca2c94879b83d7b212392770ab8358 2023-07-15 22:12:52,697 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 47e6a767c6362ff7cdcbc307c1e77505 2023-07-15 22:12:52,697 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 20ca2c94879b83d7b212392770ab8358 2023-07-15 22:12:52,699 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportFileSystemStateWithSkipTmp/47e6a767c6362ff7cdcbc307c1e77505/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 22:12:52,702 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 47e6a767c6362ff7cdcbc307c1e77505; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70608113, jitterRate=0.05214287340641022}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 22:12:52,702 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 47e6a767c6362ff7cdcbc307c1e77505: 2023-07-15 22:12:52,702 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportFileSystemStateWithSkipTmp/20ca2c94879b83d7b212392770ab8358/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 22:12:52,703 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1689459172173.47e6a767c6362ff7cdcbc307c1e77505., pid=109, masterSystemTime=1689459172672 2023-07-15 22:12:52,703 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 20ca2c94879b83d7b212392770ab8358; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66598117, jitterRate=-0.007610723376274109}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 22:12:52,703 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 20ca2c94879b83d7b212392770ab8358: 2023-07-15 22:12:52,704 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1689459172173.20ca2c94879b83d7b212392770ab8358., pid=108, masterSystemTime=1689459172671 2023-07-15 22:12:52,704 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1689459172173.47e6a767c6362ff7cdcbc307c1e77505. 2023-07-15 22:12:52,705 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1689459172173.47e6a767c6362ff7cdcbc307c1e77505. 2023-07-15 22:12:52,705 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1689459172173.20ca2c94879b83d7b212392770ab8358. 2023-07-15 22:12:52,705 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1689459172173.20ca2c94879b83d7b212392770ab8358. 2023-07-15 22:12:52,706 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=47e6a767c6362ff7cdcbc307c1e77505, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:12:52,706 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689459172173.47e6a767c6362ff7cdcbc307c1e77505.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689459172706"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689459172706"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689459172706"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689459172706"}]},"ts":"1689459172706"} 2023-07-15 22:12:52,707 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=20ca2c94879b83d7b212392770ab8358, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:52,707 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689459172173.20ca2c94879b83d7b212392770ab8358.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689459172707"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689459172707"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689459172707"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689459172707"}]},"ts":"1689459172707"} 2023-07-15 22:12:52,712 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=106 2023-07-15 22:12:52,712 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=106, state=SUCCESS; OpenRegionProcedure 47e6a767c6362ff7cdcbc307c1e77505, server=jenkins-hbase4.apache.org,38193,1689459063370 in 188 msec 2023-07-15 22:12:52,713 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=107 2023-07-15 22:12:52,713 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=107, state=SUCCESS; OpenRegionProcedure 20ca2c94879b83d7b212392770ab8358, server=jenkins-hbase4.apache.org,37287,1689459063311 in 190 msec 2023-07-15 22:12:52,714 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=47e6a767c6362ff7cdcbc307c1e77505, ASSIGN in 358 msec 2023-07-15 22:12:52,715 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=107, resume processing ppid=105 2023-07-15 22:12:52,715 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=20ca2c94879b83d7b212392770ab8358, ASSIGN in 359 msec 2023-07-15 22:12:52,716 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-15 22:12:52,716 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689459172716"}]},"ts":"1689459172716"} 2023-07-15 22:12:52,717 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-07-15 22:12:52,719 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-07-15 22:12:52,720 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-07-15 22:12:52,722 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38193] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-15 22:12:52,723 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 22:12:52,723 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 22:12:52,723 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 22:12:52,724 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 22:12:52,726 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-15 22:12:52,726 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-15 22:12:52,726 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-15 22:12:52,726 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-15 22:12:52,727 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 552 msec 2023-07-15 22:12:52,782 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-15 22:12:52,782 INFO [Listener at jenkins-hbase4.apache.org/46535] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-07-15 22:12:52,783 DEBUG [Listener at jenkins-hbase4.apache.org/46535] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemStateWithSkipTmp get assigned. Timeout = 60000ms 2023-07-15 22:12:52,783 INFO [Listener at jenkins-hbase4.apache.org/46535] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 22:12:52,787 INFO [Listener at jenkins-hbase4.apache.org/46535] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemStateWithSkipTmp assigned to meta. Checking AM states. 2023-07-15 22:12:52,787 INFO [Listener at jenkins-hbase4.apache.org/46535] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 22:12:52,787 INFO [Listener at jenkins-hbase4.apache.org/46535] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemStateWithSkipTmp assigned. 2023-07-15 22:12:52,790 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-15 22:12:52,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689459172790 (current time:1689459172790). 2023-07-15 22:12:52,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 22:12:52,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] zookeeper.ReadOnlyZKClient(139): Connect 0x38854f66 to 127.0.0.1:53678 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 22:12:52,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1ec42d79, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 22:12:52,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 22:12:52,835 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51750, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 22:12:52,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x38854f66 to 127.0.0.1:53678 2023-07-15 22:12:52,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 22:12:52,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] zookeeper.ReadOnlyZKClient(139): Connect 0x38f6e253 to 127.0.0.1:53678 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 22:12:52,851 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2a1a6454, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 22:12:52,859 DEBUG [hconnection-0x158a2b8b-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 22:12:52,866 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51758, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 22:12:52,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x38f6e253 to 127.0.0.1:53678 2023-07-15 22:12:52,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 22:12:52,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-15 22:12:52,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 22:12:52,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-15 22:12:52,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] procedure2.ProcedureExecutor(1029): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-15 22:12:52,881 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-15 22:12:52,882 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689459772882 2023-07-15 22:12:52,882 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:52,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-15 22:12:52,883 DEBUG [Listener at jenkins-hbase4.apache.org/46535] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 22:12:52,883 DEBUG [Listener at jenkins-hbase4.apache.org/46535] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 22:12:52,885 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-15 22:12:52,885 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-15 22:12:52,887 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 9 msec 2023-07-15 22:12:52,888 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-15 22:12:52,889 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689459772889 2023-07-15 22:12:52,915 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:52,915 INFO [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-15 22:12:52,915 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 22:12:52,917 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-15 22:12:52,917 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-15 22:12:52,917 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:52,917 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:52,920 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:12:52,920 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:12:52,920 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:12:52,920 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:12:52,920 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:12:52,920 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:12:52,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:12:52,920 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:12:52,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:12:52,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:12:52,920 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:12:52,920 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:52,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:52,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:52,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:52,921 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:52,921 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 22:12:52,921 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:52,921 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:52,921 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:52,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-15 22:12:52,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:52,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-15 22:12:52,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-15 22:12:52,921 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-15 22:12:52,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:52,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:52,922 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:52,922 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-15 22:12:52,922 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-15 22:12:52,922 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-15 22:12:52,922 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 22:12:52,922 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:52,928 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-15 22:12:52,928 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-15 22:12:52,928 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37287,1689459063311' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-15 22:12:52,928 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-15 22:12:52,928 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 22:12:52,930 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-15 22:12:52,930 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-15 22:12:52,930 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38193,1689459063370' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-15 22:12:52,930 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:52,930 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-15 22:12:52,930 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 22:12:52,931 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-15 22:12:52,931 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-15 22:12:52,931 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46037,1689459063224' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-15 22:12:52,937 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:52,937 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:52,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:52,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:12:52,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:12:52,937 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:52,937 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 22:12:52,938 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:52,939 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:12:52,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:12:52,939 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:52,939 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 22:12:52,939 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:52,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:12:52,939 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:52,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:52,939 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 22:12:52,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:12:52,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:52,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:52,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:12:52,942 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37287,1689459063311' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-15 22:12:52,942 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@681d762a[Count = 1] remaining members to acquire global barrier 2023-07-15 22:12:52,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:12:52,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:12:52,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:12:52,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:12:52,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:12:52,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:52,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:12:52,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:52,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:52,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:12:52,945 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38193,1689459063370' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-15 22:12:52,945 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@681d762a[Count = 0] remaining members to acquire global barrier 2023-07-15 22:12:52,945 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-15 22:12:52,945 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:52,946 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:52,946 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:52,946 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:52,946 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:52,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:52,946 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:52,946 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-15 22:12:52,946 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:52,946 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-15 22:12:52,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:52,946 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:52,947 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-15 22:12:52,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:52,947 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-15 22:12:52,947 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,46037,1689459063224' in zk 2023-07-15 22:12:52,947 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 22:12:52,947 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 22:12:52,947 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:12:52,947 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 22:12:52,947 DEBUG [rs(jenkins-hbase4.apache.org,38193,1689459063370)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689459172173.47e6a767c6362ff7cdcbc307c1e77505. 2023-07-15 22:12:52,947 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 22:12:52,947 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 22:12:52,947 DEBUG [rs(jenkins-hbase4.apache.org,38193,1689459063370)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689459172173.47e6a767c6362ff7cdcbc307c1e77505. started... 2023-07-15 22:12:52,947 DEBUG [rs(jenkins-hbase4.apache.org,37287,1689459063311)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689459172173.20ca2c94879b83d7b212392770ab8358. 2023-07-15 22:12:52,947 DEBUG [rs(jenkins-hbase4.apache.org,37287,1689459063311)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689459172173.20ca2c94879b83d7b212392770ab8358. started... 2023-07-15 22:12:52,949 DEBUG [rs(jenkins-hbase4.apache.org,38193,1689459063370)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 47e6a767c6362ff7cdcbc307c1e77505: 2023-07-15 22:12:52,949 DEBUG [rs(jenkins-hbase4.apache.org,37287,1689459063311)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 20ca2c94879b83d7b212392770ab8358: 2023-07-15 22:12:52,949 DEBUG [rs(jenkins-hbase4.apache.org,38193,1689459063370)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689459172173.47e6a767c6362ff7cdcbc307c1e77505.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:52,949 DEBUG [rs(jenkins-hbase4.apache.org,37287,1689459063311)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689459172173.20ca2c94879b83d7b212392770ab8358.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:52,950 DEBUG [rs(jenkins-hbase4.apache.org,38193,1689459063370)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 22:12:52,950 DEBUG [rs(jenkins-hbase4.apache.org,37287,1689459063311)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 22:12:52,950 DEBUG [rs(jenkins-hbase4.apache.org,38193,1689459063370)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-15 22:12:52,950 DEBUG [rs(jenkins-hbase4.apache.org,37287,1689459063311)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-15 22:12:52,951 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-15 22:12:52,951 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 22:12:52,951 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-15 22:12:52,984 DEBUG [Listener at jenkins-hbase4.apache.org/46535] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 22:12:52,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-15 22:12:52,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-15 22:12:52,985 DEBUG [Listener at jenkins-hbase4.apache.org/46535] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 22:12:53,007 DEBUG [rs(jenkins-hbase4.apache.org,37287,1689459063311)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689459172173.20ca2c94879b83d7b212392770ab8358. completed. 2023-07-15 22:12:53,007 DEBUG [rs(jenkins-hbase4.apache.org,37287,1689459063311)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689459172173.20ca2c94879b83d7b212392770ab8358. 2023-07-15 22:12:53,008 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 22:12:53,008 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 22:12:53,008 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:53,008 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-15 22:12:53,008 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,37287,1689459063311' in zk 2023-07-15 22:12:53,010 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:53,010 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-15 22:12:53,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:53,010 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 22:12:53,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:12:53,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:12:53,010 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-15 22:12:53,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:12:53,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:12:53,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:53,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:12:53,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:53,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:53,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:12:53,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:53,020 DEBUG [rs(jenkins-hbase4.apache.org,38193,1689459063370)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689459172173.47e6a767c6362ff7cdcbc307c1e77505. completed. 2023-07-15 22:12:53,020 DEBUG [rs(jenkins-hbase4.apache.org,38193,1689459063370)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689459172173.47e6a767c6362ff7cdcbc307c1e77505. 2023-07-15 22:12:53,021 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 22:12:53,021 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 22:12:53,021 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:12:53,021 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-15 22:12:53,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:53,021 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,38193,1689459063370' in zk 2023-07-15 22:12:53,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:53,023 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:12:53,023 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-15 22:12:53,023 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 22:12:53,023 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-15 22:12:53,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,37287,1689459063311': 2023-07-15 22:12:53,026 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37287,1689459063311' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-15 22:12:53,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:12:53,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:12:53,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:12:53,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:12:53,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:12:53,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:53,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:12:53,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:53,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:53,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:12:53,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:53,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:12:53,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:53,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:53,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,38193,1689459063370': 2023-07-15 22:12:53,033 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38193,1689459063370' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-15 22:12:53,033 INFO [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-15 22:12:53,033 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 22:12:53,033 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 22:12:53,033 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:53,033 INFO [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 22:12:53,037 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:53,037 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:53,037 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:12:53,037 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:12:53,037 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:53,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:53,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:12:53,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:12:53,037 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:53,037 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:53,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:53,037 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:53,044 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:12:53,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:53,044 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:53,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:53,048 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:12:53,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:12:53,048 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:12:53,048 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:12:53,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:12:53,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:12:53,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:12:53,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:53,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:53,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:53,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:53,049 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:12:53,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:12:53,050 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:53,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:53,050 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:53,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:12:53,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:53,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:53,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:12:53,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:53,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:12:53,052 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:12:53,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:53,052 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:53,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:53,053 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:53,056 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:53,056 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:12:53,056 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:53,056 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:12:53,056 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:12:53,056 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:53,057 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:12:53,057 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:12:53,057 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:12:53,057 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:12:53,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:12:53,056 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:12:53,057 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:12:53,057 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:12:53,057 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 22:12:53,057 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:53,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:12:53,059 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:53,059 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:53,057 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:53,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:12:53,059 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:53,059 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:12:53,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:12:53,059 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:53,059 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:12:53,059 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:53,059 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:53,059 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:12:53,059 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:12:53,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:12:53,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:12:53,060 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:53,108 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:53,177 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-15 22:12:53,177 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:53,178 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:53,178 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689459172882Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689459173059 (+177 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689459173059Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689459173069 (+10 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689459173102 (+33 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689459173177 (+75 ms) 2023-07-15 22:12:53,181 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-15 22:12:53,184 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 298 msec 2023-07-15 22:12:53,185 DEBUG [Listener at jenkins-hbase4.apache.org/46535] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 22:12:53,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-15 22:12:53,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 22:12:53,196 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38193] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1689459172173.47e6a767c6362ff7cdcbc307c1e77505. with WAL disabled. Data may be lost in the event of a crash. 2023-07-15 22:12:53,203 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37287] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1689459172173.20ca2c94879b83d7b212392770ab8358. with WAL disabled. Data may be lost in the event of a crash. 2023-07-15 22:12:53,240 DEBUG [Listener at jenkins-hbase4.apache.org/46535] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:53,240 DEBUG [Listener at jenkins-hbase4.apache.org/46535] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689459172173.47e6a767c6362ff7cdcbc307c1e77505. 2023-07-15 22:12:53,242 INFO [Listener at jenkins-hbase4.apache.org/46535] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 22:12:53,278 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-15 22:12:53,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689459173278 (current time:1689459173278). 2023-07-15 22:12:53,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 22:12:53,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] zookeeper.ReadOnlyZKClient(139): Connect 0x1dd55531 to 127.0.0.1:53678 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 22:12:53,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5947f373, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 22:12:53,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 22:12:53,324 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51770, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 22:12:53,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1dd55531 to 127.0.0.1:53678 2023-07-15 22:12:53,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 22:12:53,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] zookeeper.ReadOnlyZKClient(139): Connect 0x0a65b3cd to 127.0.0.1:53678 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 22:12:53,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3dae036d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 22:12:53,390 DEBUG [hconnection-0x5b14b3c0-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 22:12:53,396 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51782, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 22:12:53,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0a65b3cd to 127.0.0.1:53678 2023-07-15 22:12:53,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 22:12:53,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-15 22:12:53,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 22:12:53,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-15 22:12:53,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-15 22:12:53,410 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-15 22:12:53,411 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689459773411 2023-07-15 22:12:53,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-15 22:12:53,411 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:53,412 DEBUG [Listener at jenkins-hbase4.apache.org/46535] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 22:12:53,412 DEBUG [Listener at jenkins-hbase4.apache.org/46535] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 22:12:53,424 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-15 22:12:53,426 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-15 22:12:53,427 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 17 msec 2023-07-15 22:12:53,429 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-15 22:12:53,431 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689459773431 2023-07-15 22:12:53,512 DEBUG [Listener at jenkins-hbase4.apache.org/46535] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 22:12:53,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-15 22:12:53,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-15 22:12:53,514 DEBUG [Listener at jenkins-hbase4.apache.org/46535] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 22:12:53,537 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:53,537 INFO [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-15 22:12:53,537 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 22:12:53,537 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-15 22:12:53,537 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-15 22:12:53,538 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:53,538 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:53,539 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:12:53,539 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:12:53,539 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:12:53,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:12:53,540 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:12:53,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:53,540 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:53,541 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:53,541 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 22:12:53,541 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:53,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-15 22:12:53,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:53,541 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-15 22:12:53,542 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:12:53,542 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:12:53,543 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:12:53,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:12:53,543 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:12:53,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:12:53,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:53,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:53,544 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:53,544 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:53,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-15 22:12:53,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:53,545 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-15 22:12:53,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-15 22:12:53,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:53,545 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:53,545 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-15 22:12:53,545 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-15 22:12:53,545 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 22:12:53,556 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:53,556 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-15 22:12:53,556 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 22:12:53,558 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:53,566 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-15 22:12:53,566 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 22:12:53,566 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-15 22:12:53,566 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-15 22:12:53,579 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-15 22:12:53,579 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46037,1689459063224' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-15 22:12:53,569 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-15 22:12:53,579 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-15 22:12:53,579 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37287,1689459063311' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-15 22:12:53,566 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-15 22:12:53,580 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38193,1689459063370' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-15 22:12:53,581 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:53,583 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:53,583 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:12:53,583 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:53,583 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 22:12:53,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:53,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:12:53,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:12:53,583 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:53,583 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:53,584 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:53,584 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 22:12:53,584 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:53,584 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 22:12:53,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:12:53,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:12:53,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:53,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:12:53,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:53,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:53,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:12:53,589 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37287,1689459063311' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-15 22:12:53,589 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@12f28363[Count = 1] remaining members to acquire global barrier 2023-07-15 22:12:53,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:12:53,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:12:53,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:12:53,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:12:53,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:12:53,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:53,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:12:53,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:53,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:53,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:12:53,594 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38193,1689459063370' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-15 22:12:53,594 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@12f28363[Count = 0] remaining members to acquire global barrier 2023-07-15 22:12:53,594 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-15 22:12:53,594 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:53,600 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:53,600 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:53,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:53,601 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:53,601 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-15 22:12:53,601 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-15 22:12:53,601 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,46037,1689459063224' in zk 2023-07-15 22:12:53,601 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:53,601 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:53,601 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:53,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:53,601 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-15 22:12:53,601 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:53,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:53,603 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:12:53,603 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 22:12:53,603 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-15 22:12:53,604 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-15 22:12:53,604 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 22:12:53,604 DEBUG [member: 'jenkins-hbase4.apache.org,46037,1689459063224' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-15 22:12:53,608 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 22:12:53,608 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 22:12:53,623 DEBUG [rs(jenkins-hbase4.apache.org,38193,1689459063370)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689459172173.47e6a767c6362ff7cdcbc307c1e77505. 2023-07-15 22:12:53,623 DEBUG [rs(jenkins-hbase4.apache.org,37287,1689459063311)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689459172173.20ca2c94879b83d7b212392770ab8358. 2023-07-15 22:12:53,623 DEBUG [rs(jenkins-hbase4.apache.org,37287,1689459063311)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689459172173.20ca2c94879b83d7b212392770ab8358. started... 2023-07-15 22:12:53,623 INFO [rs(jenkins-hbase4.apache.org,37287,1689459063311)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 20ca2c94879b83d7b212392770ab8358 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-15 22:12:53,622 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 22:12:53,624 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 22:12:53,623 DEBUG [rs(jenkins-hbase4.apache.org,38193,1689459063370)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689459172173.47e6a767c6362ff7cdcbc307c1e77505. started... 2023-07-15 22:12:53,624 INFO [rs(jenkins-hbase4.apache.org,38193,1689459063370)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 47e6a767c6362ff7cdcbc307c1e77505 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-15 22:12:53,714 DEBUG [Listener at jenkins-hbase4.apache.org/46535] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 22:12:53,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-15 22:12:53,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-15 22:12:53,716 DEBUG [Listener at jenkins-hbase4.apache.org/46535] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-15 22:12:53,736 INFO [rs(jenkins-hbase4.apache.org,37287,1689459063311)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.13 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportFileSystemStateWithSkipTmp/20ca2c94879b83d7b212392770ab8358/.tmp/cf/86b72728cbb44a0ca416357a30c97889 2023-07-15 22:12:53,745 DEBUG [rs(jenkins-hbase4.apache.org,37287,1689459063311)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportFileSystemStateWithSkipTmp/20ca2c94879b83d7b212392770ab8358/.tmp/cf/86b72728cbb44a0ca416357a30c97889 as hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportFileSystemStateWithSkipTmp/20ca2c94879b83d7b212392770ab8358/cf/86b72728cbb44a0ca416357a30c97889 2023-07-15 22:12:53,747 INFO [rs(jenkins-hbase4.apache.org,38193,1689459063370)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=132 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportFileSystemStateWithSkipTmp/47e6a767c6362ff7cdcbc307c1e77505/.tmp/cf/053a76a599e6438989bb80c5946f96e5 2023-07-15 22:12:53,754 DEBUG [rs(jenkins-hbase4.apache.org,38193,1689459063370)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportFileSystemStateWithSkipTmp/47e6a767c6362ff7cdcbc307c1e77505/.tmp/cf/053a76a599e6438989bb80c5946f96e5 as hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportFileSystemStateWithSkipTmp/47e6a767c6362ff7cdcbc307c1e77505/cf/053a76a599e6438989bb80c5946f96e5 2023-07-15 22:12:53,761 INFO [rs(jenkins-hbase4.apache.org,38193,1689459063370)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportFileSystemStateWithSkipTmp/47e6a767c6362ff7cdcbc307c1e77505/cf/053a76a599e6438989bb80c5946f96e5, entries=2, sequenceid=6, filesize=5.0 K 2023-07-15 22:12:53,762 INFO [rs(jenkins-hbase4.apache.org,38193,1689459063370)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for 47e6a767c6362ff7cdcbc307c1e77505 in 138ms, sequenceid=6, compaction requested=false 2023-07-15 22:12:53,762 DEBUG [rs(jenkins-hbase4.apache.org,38193,1689459063370)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-15 22:12:53,763 DEBUG [rs(jenkins-hbase4.apache.org,38193,1689459063370)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 47e6a767c6362ff7cdcbc307c1e77505: 2023-07-15 22:12:53,766 INFO [rs(jenkins-hbase4.apache.org,37287,1689459063311)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportFileSystemStateWithSkipTmp/20ca2c94879b83d7b212392770ab8358/cf/86b72728cbb44a0ca416357a30c97889, entries=48, sequenceid=6, filesize=8.1 K 2023-07-15 22:12:53,767 INFO [rs(jenkins-hbase4.apache.org,37287,1689459063311)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 20ca2c94879b83d7b212392770ab8358 in 143ms, sequenceid=6, compaction requested=false 2023-07-15 22:12:53,769 DEBUG [rs(jenkins-hbase4.apache.org,37287,1689459063311)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 20ca2c94879b83d7b212392770ab8358: 2023-07-15 22:12:53,769 DEBUG [rs(jenkins-hbase4.apache.org,38193,1689459063370)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689459172173.47e6a767c6362ff7cdcbc307c1e77505.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:53,769 DEBUG [rs(jenkins-hbase4.apache.org,37287,1689459063311)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689459172173.20ca2c94879b83d7b212392770ab8358.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:53,769 DEBUG [rs(jenkins-hbase4.apache.org,38193,1689459063370)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 22:12:53,769 DEBUG [rs(jenkins-hbase4.apache.org,37287,1689459063311)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 22:12:53,769 DEBUG [rs(jenkins-hbase4.apache.org,38193,1689459063370)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportFileSystemStateWithSkipTmp/47e6a767c6362ff7cdcbc307c1e77505/cf/053a76a599e6438989bb80c5946f96e5] hfiles 2023-07-15 22:12:53,769 DEBUG [rs(jenkins-hbase4.apache.org,37287,1689459063311)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportFileSystemStateWithSkipTmp/20ca2c94879b83d7b212392770ab8358/cf/86b72728cbb44a0ca416357a30c97889] hfiles 2023-07-15 22:12:53,769 DEBUG [rs(jenkins-hbase4.apache.org,38193,1689459063370)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportFileSystemStateWithSkipTmp/47e6a767c6362ff7cdcbc307c1e77505/cf/053a76a599e6438989bb80c5946f96e5 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:53,769 DEBUG [rs(jenkins-hbase4.apache.org,37287,1689459063311)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportFileSystemStateWithSkipTmp/20ca2c94879b83d7b212392770ab8358/cf/86b72728cbb44a0ca416357a30c97889 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:53,855 DEBUG [rs(jenkins-hbase4.apache.org,38193,1689459063370)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689459172173.47e6a767c6362ff7cdcbc307c1e77505. completed. 2023-07-15 22:12:53,856 DEBUG [rs(jenkins-hbase4.apache.org,38193,1689459063370)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689459172173.47e6a767c6362ff7cdcbc307c1e77505. 2023-07-15 22:12:53,856 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 22:12:53,856 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 22:12:53,856 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:12:53,856 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-15 22:12:53,856 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,38193,1689459063370' in zk 2023-07-15 22:12:53,858 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:12:53,858 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-15 22:12:53,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:12:53,858 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 22:12:53,858 DEBUG [member: 'jenkins-hbase4.apache.org,38193,1689459063370' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-15 22:12:53,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:12:53,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:12:53,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:12:53,862 DEBUG [rs(jenkins-hbase4.apache.org,37287,1689459063311)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689459172173.20ca2c94879b83d7b212392770ab8358. completed. 2023-07-15 22:12:53,862 DEBUG [rs(jenkins-hbase4.apache.org,37287,1689459063311)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689459172173.20ca2c94879b83d7b212392770ab8358. 2023-07-15 22:12:53,862 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 22:12:53,862 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 22:12:53,863 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:53,863 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-15 22:12:53,863 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,37287,1689459063311' in zk 2023-07-15 22:12:53,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:12:53,867 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-15 22:12:53,867 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:53,867 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 22:12:53,867 DEBUG [member: 'jenkins-hbase4.apache.org,37287,1689459063311' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-15 22:12:53,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:53,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:12:53,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:53,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:53,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:12:53,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:53,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:12:53,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:53,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:53,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,38193,1689459063370': 2023-07-15 22:12:53,874 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38193,1689459063370' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-15 22:12:53,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:53,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:12:53,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:12:53,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:12:53,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:12:53,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:53,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:12:53,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:53,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:53,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:12:53,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:53,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:12:53,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:53,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:53,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,37287,1689459063311': 2023-07-15 22:12:53,889 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37287,1689459063311' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-15 22:12:53,889 INFO [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-15 22:12:53,889 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 22:12:53,889 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 22:12:53,889 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:53,889 INFO [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 22:12:53,893 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:53,893 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:53,893 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:53,893 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:53,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:53,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 22:12:53,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 22:12:53,893 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:12:53,893 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:53,893 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:12:53,893 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:53,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:53,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:53,893 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:53,893 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:12:53,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:53,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 22:12:53,894 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:12:53,894 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:12:53,894 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:12:53,894 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:12:53,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:53,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:12:53,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:12:53,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:12:53,894 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:53,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:53,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 22:12:53,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:53,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:53,895 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:53,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:53,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:12:53,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:53,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:53,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 22:12:53,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:53,903 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:12:53,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:12:53,905 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:53,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:53,905 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:53,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:53,910 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:53,910 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:53,910 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:53,910 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:12:53,910 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:53,910 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:12:53,910 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:53,910 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:12:53,910 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:12:53,910 DEBUG [(jenkins-hbase4.apache.org,42893,1689459061608)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 22:12:53,911 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:53,911 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:12:53,913 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:53,913 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:12:53,913 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:12:53,913 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:53,913 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:53,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:12:53,910 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:12:53,910 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:12:53,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:12:53,910 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 22:12:53,913 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:12:53,910 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 22:12:53,913 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:53,913 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 22:12:53,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 22:12:53,913 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:12:53,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:12:53,914 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:12:53,914 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 22:12:53,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:12:53,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 22:12:53,963 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:53,992 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-15 22:12:53,992 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:53,992 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:53,992 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689459173411Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689459173910 (+499 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1689459173911 (+1 ms)Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1689459173923 (+12 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689459173956 (+33 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689459173992 (+36 ms) 2023-07-15 22:12:53,995 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-15 22:12:53,997 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 573 msec 2023-07-15 22:12:54,016 DEBUG [Listener at jenkins-hbase4.apache.org/46535] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 22:12:54,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-15 22:12:54,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 22:12:54,018 INFO [Listener at jenkins-hbase4.apache.org/46535] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/export-test/export-1689459174018 2023-07-15 22:12:54,018 INFO [Listener at jenkins-hbase4.apache.org/46535] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:33847, tgtDir=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/export-test/export-1689459174018, rawTgtDir=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/export-test/export-1689459174018, srcFsUri=hdfs://localhost:33847, srcDir=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e 2023-07-15 22:12:54,049 DEBUG [Listener at jenkins-hbase4.apache.org/46535] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:33847, inputRoot=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e 2023-07-15 22:12:54,049 DEBUG [Listener at jenkins-hbase4.apache.org/46535] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1687922454_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/export-test/export-1689459174018, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/export-test/export-1689459174018/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:54,049 INFO [Listener at jenkins-hbase4.apache.org/46535] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:33847, inputRoot=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e, snapshotDir=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-07-15 22:12:54,078 INFO [Listener at jenkins-hbase4.apache.org/46535] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/export-test/export-1689459174018/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:12:54,168 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-15 22:12:54,168 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-15 22:12:54,169 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-15 22:12:54,170 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-15 22:12:54,170 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-15 22:12:54,171 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-15 22:12:54,171 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-15 22:12:54,255 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97e758c6-fe86-0ed9-092f-cd0594d33e04/hadoop-2358368917956367557.jar 2023-07-15 22:12:54,256 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-15 22:12:54,257 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-15 22:12:54,257 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-15 22:12:54,257 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-15 22:12:54,258 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-15 22:12:54,258 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-15 22:12:54,259 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-15 22:12:54,259 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-15 22:12:54,259 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-15 22:12:54,260 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-15 22:12:54,260 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-15 22:12:54,261 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-15 22:12:54,261 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-15 22:12:54,261 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-15 22:12:54,261 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-15 22:12:54,262 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-15 22:12:54,262 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 22:12:54,263 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 22:12:54,263 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 22:12:54,263 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 22:12:54,264 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 22:12:54,264 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 22:12:54,264 DEBUG [Listener at jenkins-hbase4.apache.org/46535] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 22:12:55,797 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689459070788_0006_000001 (auth:SIMPLE) 2023-07-15 22:12:56,100 WARN [Listener at jenkins-hbase4.apache.org/46535] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-15 22:12:56,105 INFO [Listener at jenkins-hbase4.apache.org/46535] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-07-15 22:12:56,109 DEBUG [Listener at jenkins-hbase4.apache.org/46535] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-15 22:12:56,335 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 22:12:56,335 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 22:12:56,827 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689459070788_0007_000001 (auth:SIMPLE) 2023-07-15 22:12:56,967 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-15 22:13:01,734 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689459070788_0007_000001 (auth:SIMPLE) 2023-07-15 22:13:04,017 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689459070788_0007_000001 (auth:SIMPLE) 2023-07-15 22:13:07,439 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689459070788_0007_000001 (auth:SIMPLE) 2023-07-15 22:13:08,514 INFO [Listener at jenkins-hbase4.apache.org/46535] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-15 22:13:08,514 INFO [Listener at jenkins-hbase4.apache.org/46535] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-15 22:13:08,528 INFO [Listener at jenkins-hbase4.apache.org/46535] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:08,529 INFO [Listener at jenkins-hbase4.apache.org/46535] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-15 22:13:08,529 INFO [Listener at jenkins-hbase4.apache.org/46535] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-15 22:13:08,530 DEBUG [Listener at jenkins-hbase4.apache.org/46535] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2077448059_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:08,531 DEBUG [Listener at jenkins-hbase4.apache.org/46535] snapshot.TestExportSnapshot(367): hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-15 22:13:08,531 DEBUG [Listener at jenkins-hbase4.apache.org/46535] snapshot.TestExportSnapshot(367): hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-15 22:13:08,531 DEBUG [Listener at jenkins-hbase4.apache.org/46535] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2077448059_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/export-test/export-1689459174018/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/export-test/export-1689459174018/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:08,531 DEBUG [Listener at jenkins-hbase4.apache.org/46535] snapshot.TestExportSnapshot(367): hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/export-test/export-1689459174018/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-15 22:13:08,531 DEBUG [Listener at jenkins-hbase4.apache.org/46535] snapshot.TestExportSnapshot(367): hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/export-test/export-1689459174018/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-15 22:13:08,554 INFO [Listener at jenkins-hbase4.apache.org/46535] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:08,554 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:08,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] procedure2.ProcedureExecutor(1029): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:08,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-15 22:13:08,561 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689459188561"}]},"ts":"1689459188561"} 2023-07-15 22:13:08,567 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-07-15 22:13:08,568 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-07-15 22:13:08,569 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=47e6a767c6362ff7cdcbc307c1e77505, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=20ca2c94879b83d7b212392770ab8358, UNASSIGN}] 2023-07-15 22:13:08,572 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=47e6a767c6362ff7cdcbc307c1e77505, UNASSIGN 2023-07-15 22:13:08,572 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=20ca2c94879b83d7b212392770ab8358, UNASSIGN 2023-07-15 22:13:08,572 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=20ca2c94879b83d7b212392770ab8358, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:13:08,572 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=47e6a767c6362ff7cdcbc307c1e77505, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:13:08,573 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689459172173.20ca2c94879b83d7b212392770ab8358.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689459188572"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689459188572"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689459188572"}]},"ts":"1689459188572"} 2023-07-15 22:13:08,573 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689459172173.47e6a767c6362ff7cdcbc307c1e77505.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689459188572"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689459188572"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689459188572"}]},"ts":"1689459188572"} 2023-07-15 22:13:08,575 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure 47e6a767c6362ff7cdcbc307c1e77505, server=jenkins-hbase4.apache.org,38193,1689459063370}] 2023-07-15 22:13:08,581 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure 20ca2c94879b83d7b212392770ab8358, server=jenkins-hbase4.apache.org,37287,1689459063311}] 2023-07-15 22:13:08,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-15 22:13:08,731 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 47e6a767c6362ff7cdcbc307c1e77505 2023-07-15 22:13:08,732 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 47e6a767c6362ff7cdcbc307c1e77505, disabling compactions & flushes 2023-07-15 22:13:08,732 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689459172173.47e6a767c6362ff7cdcbc307c1e77505. 2023-07-15 22:13:08,732 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689459172173.47e6a767c6362ff7cdcbc307c1e77505. 2023-07-15 22:13:08,732 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689459172173.47e6a767c6362ff7cdcbc307c1e77505. after waiting 0 ms 2023-07-15 22:13:08,732 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689459172173.47e6a767c6362ff7cdcbc307c1e77505. 2023-07-15 22:13:08,735 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 20ca2c94879b83d7b212392770ab8358 2023-07-15 22:13:08,735 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 20ca2c94879b83d7b212392770ab8358, disabling compactions & flushes 2023-07-15 22:13:08,735 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689459172173.20ca2c94879b83d7b212392770ab8358. 2023-07-15 22:13:08,735 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689459172173.20ca2c94879b83d7b212392770ab8358. 2023-07-15 22:13:08,735 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689459172173.20ca2c94879b83d7b212392770ab8358. after waiting 0 ms 2023-07-15 22:13:08,735 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689459172173.20ca2c94879b83d7b212392770ab8358. 2023-07-15 22:13:08,762 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportFileSystemStateWithSkipTmp/47e6a767c6362ff7cdcbc307c1e77505/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 22:13:08,763 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 22:13:08,768 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689459172173.47e6a767c6362ff7cdcbc307c1e77505. 2023-07-15 22:13:08,768 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 47e6a767c6362ff7cdcbc307c1e77505: 2023-07-15 22:13:08,768 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/default/testtb-testExportFileSystemStateWithSkipTmp/20ca2c94879b83d7b212392770ab8358/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 22:13:08,770 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 47e6a767c6362ff7cdcbc307c1e77505 2023-07-15 22:13:08,770 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=47e6a767c6362ff7cdcbc307c1e77505, regionState=CLOSED 2023-07-15 22:13:08,770 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689459172173.47e6a767c6362ff7cdcbc307c1e77505.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689459188770"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689459188770"}]},"ts":"1689459188770"} 2023-07-15 22:13:08,774 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=115 2023-07-15 22:13:08,774 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure 47e6a767c6362ff7cdcbc307c1e77505, server=jenkins-hbase4.apache.org,38193,1689459063370 in 197 msec 2023-07-15 22:13:08,775 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 22:13:08,778 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689459172173.20ca2c94879b83d7b212392770ab8358. 2023-07-15 22:13:08,778 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 20ca2c94879b83d7b212392770ab8358: 2023-07-15 22:13:08,778 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=47e6a767c6362ff7cdcbc307c1e77505, UNASSIGN in 205 msec 2023-07-15 22:13:08,780 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 20ca2c94879b83d7b212392770ab8358 2023-07-15 22:13:08,780 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=20ca2c94879b83d7b212392770ab8358, regionState=CLOSED 2023-07-15 22:13:08,780 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689459172173.20ca2c94879b83d7b212392770ab8358.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689459188780"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689459188780"}]},"ts":"1689459188780"} 2023-07-15 22:13:08,784 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=116 2023-07-15 22:13:08,784 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure 20ca2c94879b83d7b212392770ab8358, server=jenkins-hbase4.apache.org,37287,1689459063311 in 202 msec 2023-07-15 22:13:08,786 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=116, resume processing ppid=114 2023-07-15 22:13:08,787 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=20ca2c94879b83d7b212392770ab8358, UNASSIGN in 215 msec 2023-07-15 22:13:08,787 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689459188787"}]},"ts":"1689459188787"} 2023-07-15 22:13:08,788 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-07-15 22:13:08,790 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-07-15 22:13:08,798 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 235 msec 2023-07-15 22:13:08,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-15 22:13:08,864 INFO [Listener at jenkins-hbase4.apache.org/46535] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-07-15 22:13:08,865 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:08,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] procedure2.ProcedureExecutor(1029): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:08,870 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:08,870 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:08,872 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:08,873 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38193] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:08,878 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:08,878 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:08,878 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:08,878 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/47e6a767c6362ff7cdcbc307c1e77505 2023-07-15 22:13:08,879 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-15 22:13:08,879 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-15 22:13:08,879 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-15 22:13:08,883 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:08,883 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-15 22:13:08,887 DEBUG [HFileArchiver-23] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/20ca2c94879b83d7b212392770ab8358 2023-07-15 22:13:08,888 DEBUG [HFileArchiver-22] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/47e6a767c6362ff7cdcbc307c1e77505/cf, FileablePath, hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/47e6a767c6362ff7cdcbc307c1e77505/recovered.edits] 2023-07-15 22:13:08,890 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:08,890 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 22:13:08,890 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:08,891 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 22:13:08,891 DEBUG [HFileArchiver-23] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/20ca2c94879b83d7b212392770ab8358/cf, FileablePath, hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/20ca2c94879b83d7b212392770ab8358/recovered.edits] 2023-07-15 22:13:08,891 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:08,891 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 22:13:08,891 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:08,891 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 22:13:08,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-15 22:13:08,895 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/47e6a767c6362ff7cdcbc307c1e77505/cf/053a76a599e6438989bb80c5946f96e5 to hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/47e6a767c6362ff7cdcbc307c1e77505/cf/053a76a599e6438989bb80c5946f96e5 2023-07-15 22:13:08,900 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/47e6a767c6362ff7cdcbc307c1e77505/recovered.edits/9.seqid to hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/47e6a767c6362ff7cdcbc307c1e77505/recovered.edits/9.seqid 2023-07-15 22:13:08,902 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/20ca2c94879b83d7b212392770ab8358/cf/86b72728cbb44a0ca416357a30c97889 to hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/20ca2c94879b83d7b212392770ab8358/cf/86b72728cbb44a0ca416357a30c97889 2023-07-15 22:13:08,902 DEBUG [HFileArchiver-22] backup.HFileArchiver(596): Deleted hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/47e6a767c6362ff7cdcbc307c1e77505 2023-07-15 22:13:08,907 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/20ca2c94879b83d7b212392770ab8358/recovered.edits/9.seqid to hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/20ca2c94879b83d7b212392770ab8358/recovered.edits/9.seqid 2023-07-15 22:13:08,909 DEBUG [HFileArchiver-23] backup.HFileArchiver(596): Deleted hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/20ca2c94879b83d7b212392770ab8358 2023-07-15 22:13:08,909 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-15 22:13:08,911 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:08,913 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-07-15 22:13:08,916 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-07-15 22:13:08,917 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:08,917 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-07-15 22:13:08,918 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689459172173.47e6a767c6362ff7cdcbc307c1e77505.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689459188917"}]},"ts":"9223372036854775807"} 2023-07-15 22:13:08,918 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689459172173.20ca2c94879b83d7b212392770ab8358.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689459188917"}]},"ts":"9223372036854775807"} 2023-07-15 22:13:08,936 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-15 22:13:08,936 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 47e6a767c6362ff7cdcbc307c1e77505, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689459172173.47e6a767c6362ff7cdcbc307c1e77505.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 20ca2c94879b83d7b212392770ab8358, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689459172173.20ca2c94879b83d7b212392770ab8358.', STARTKEY => '1', ENDKEY => ''}] 2023-07-15 22:13:08,936 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-07-15 22:13:08,937 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689459188936"}]},"ts":"9223372036854775807"} 2023-07-15 22:13:08,940 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-07-15 22:13:08,943 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:08,945 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 79 msec 2023-07-15 22:13:08,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-15 22:13:08,994 INFO [Listener at jenkins-hbase4.apache.org/46535] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-07-15 22:13:09,003 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-15 22:13:09,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:09,007 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-15 22:13:09,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42893] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 22:13:09,039 INFO [Listener at jenkins-hbase4.apache.org/46535] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=764 (was 763) Potentially hanging thread: IPC Client (905985230) connection to jenkins-hbase4.apache.org/172.31.14.131:42429 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2077448059_17 at /127.0.0.1:45062 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-7210997_1 at /127.0.0.1:40246 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-22 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-5203 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: HFileArchiver-23 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2077448059_17 at /127.0.0.1:40274 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x57410306-shared-pool-45 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x57410306-shared-pool-44 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x57410306-shared-pool-42 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x57410306-shared-pool-43 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2077448059_17 at /127.0.0.1:58722 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=899 (was 920), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=607 (was 578) - SystemLoadAverage LEAK? -, ProcessCount=182 (was 182), AvailableMemoryMB=2028 (was 2222) 2023-07-15 22:13:09,039 WARN [Listener at jenkins-hbase4.apache.org/46535] hbase.ResourceChecker(130): Thread=764 is superior to 500 2023-07-15 22:13:09,039 INFO [Listener at jenkins-hbase4.apache.org/46535] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-07-15 22:13:09,079 INFO [Listener at jenkins-hbase4.apache.org/46535] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-15 22:13:13,635 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689459070788_0007_000001 (auth:SIMPLE) 2023-07-15 22:13:14,336 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-15 22:13:23,108 INFO [Listener at jenkins-hbase4.apache.org/46535] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-15 22:13:37,230 ERROR [Thread[Thread-408,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-15 22:13:37,231 INFO [Listener at jenkins-hbase4.apache.org/46535] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-15 22:13:37,344 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-07-15 22:13:37,361 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-07-15 22:13:37,362 ERROR [Thread[Thread-418,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-15 22:13:37,376 INFO [Listener at jenkins-hbase4.apache.org/46535] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-15 22:13:37,480 ERROR [Thread[Thread-383,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-15 22:13:37,480 INFO [Listener at jenkins-hbase4.apache.org/46535] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-07-15 22:13:37,480 INFO [Listener at jenkins-hbase4.apache.org/46535] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-15 22:13:37,480 INFO [Listener at jenkins-hbase4.apache.org/46535] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-15 22:13:37,480 DEBUG [Listener at jenkins-hbase4.apache.org/46535] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1370d70b to 127.0.0.1:53678 2023-07-15 22:13:37,480 DEBUG [Listener at jenkins-hbase4.apache.org/46535] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 22:13:37,481 DEBUG [Listener at jenkins-hbase4.apache.org/46535] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-15 22:13:37,481 DEBUG [Listener at jenkins-hbase4.apache.org/46535] util.JVMClusterUtil(257): Found active master hash=153919783, stopped=false 2023-07-15 22:13:37,481 DEBUG [Listener at jenkins-hbase4.apache.org/46535] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 22:13:37,481 DEBUG [Listener at jenkins-hbase4.apache.org/46535] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-15 22:13:37,481 INFO [Listener at jenkins-hbase4.apache.org/46535] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,42893,1689459061608 2023-07-15 22:13:37,484 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-15 22:13:37,484 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-15 22:13:37,484 INFO [Listener at jenkins-hbase4.apache.org/46535] procedure2.ProcedureExecutor(629): Stopping 2023-07-15 22:13:37,484 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-15 22:13:37,484 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 22:13:37,484 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-15 22:13:37,484 DEBUG [Listener at jenkins-hbase4.apache.org/46535] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x515338a4 to 127.0.0.1:53678 2023-07-15 22:13:37,484 DEBUG [Listener at jenkins-hbase4.apache.org/46535] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 22:13:37,484 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-15 22:13:37,484 INFO [Listener at jenkins-hbase4.apache.org/46535] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,46037,1689459063224' ***** 2023-07-15 22:13:37,485 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-15 22:13:37,485 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-15 22:13:37,485 DEBUG [Listener at jenkins-hbase4.apache.org/46535] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 22:13:37,485 INFO [Listener at jenkins-hbase4.apache.org/46535] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-15 22:13:37,484 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-15 22:13:37,485 INFO [RS:0;jenkins-hbase4:46037] regionserver.HeapMemoryManager(220): Stopping 2023-07-15 22:13:37,485 INFO [RS:0;jenkins-hbase4:46037] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-15 22:13:37,485 INFO [RS:0;jenkins-hbase4:46037] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-15 22:13:37,486 INFO [RS:0;jenkins-hbase4:46037] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:13:37,486 DEBUG [RS:0;jenkins-hbase4:46037] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7c99c080 to 127.0.0.1:53678 2023-07-15 22:13:37,486 DEBUG [RS:0;jenkins-hbase4:46037] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 22:13:37,485 INFO [Listener at jenkins-hbase4.apache.org/46535] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,37287,1689459063311' ***** 2023-07-15 22:13:37,485 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-15 22:13:37,486 DEBUG [Listener at jenkins-hbase4.apache.org/46535] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 22:13:37,486 INFO [Listener at jenkins-hbase4.apache.org/46535] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-15 22:13:37,486 INFO [Listener at jenkins-hbase4.apache.org/46535] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,38193,1689459063370' ***** 2023-07-15 22:13:37,486 DEBUG [Listener at jenkins-hbase4.apache.org/46535] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 22:13:37,486 INFO [Listener at jenkins-hbase4.apache.org/46535] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-15 22:13:37,486 INFO [RS:1;jenkins-hbase4:37287] regionserver.HeapMemoryManager(220): Stopping 2023-07-15 22:13:37,486 INFO [RS:1;jenkins-hbase4:37287] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-15 22:13:37,486 INFO [RS:1;jenkins-hbase4:37287] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-15 22:13:37,486 INFO [RS:1;jenkins-hbase4:37287] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:13:37,486 INFO [RS:2;jenkins-hbase4:38193] regionserver.HeapMemoryManager(220): Stopping 2023-07-15 22:13:37,487 DEBUG [RS:1;jenkins-hbase4:37287] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3e2a0a7b to 127.0.0.1:53678 2023-07-15 22:13:37,487 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-15 22:13:37,487 DEBUG [RS:1;jenkins-hbase4:37287] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 22:13:37,487 INFO [RS:2;jenkins-hbase4:38193] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-15 22:13:37,487 INFO [RS:2;jenkins-hbase4:38193] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-15 22:13:37,487 INFO [RS:2;jenkins-hbase4:38193] regionserver.HRegionServer(3305): Received CLOSE for 193c8a58fbee6a39e80e28b4f899ac4c 2023-07-15 22:13:37,487 INFO [RS:2;jenkins-hbase4:38193] regionserver.HRegionServer(3305): Received CLOSE for 1a569e443e1a4e5bb2e4d421117ad46c 2023-07-15 22:13:37,487 INFO [RS:2;jenkins-hbase4:38193] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:13:37,487 DEBUG [RS:2;jenkins-hbase4:38193] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x236e8ee8 to 127.0.0.1:53678 2023-07-15 22:13:37,487 DEBUG [RS:2;jenkins-hbase4:38193] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 22:13:37,487 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-15 22:13:37,492 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 193c8a58fbee6a39e80e28b4f899ac4c, disabling compactions & flushes 2023-07-15 22:13:37,493 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689459066320.193c8a58fbee6a39e80e28b4f899ac4c. 2023-07-15 22:13:37,493 INFO [RS:1;jenkins-hbase4:37287] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,37287,1689459063311; all regions closed. 2023-07-15 22:13:37,493 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689459066320.193c8a58fbee6a39e80e28b4f899ac4c. 2023-07-15 22:13:37,493 INFO [RS:2;jenkins-hbase4:38193] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-15 22:13:37,493 INFO [RS:0;jenkins-hbase4:46037] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,46037,1689459063224; all regions closed. 2023-07-15 22:13:37,494 INFO [RS:2;jenkins-hbase4:38193] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-15 22:13:37,494 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689459066320.193c8a58fbee6a39e80e28b4f899ac4c. after waiting 0 ms 2023-07-15 22:13:37,494 INFO [RS:2;jenkins-hbase4:38193] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-15 22:13:37,494 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689459066320.193c8a58fbee6a39e80e28b4f899ac4c. 2023-07-15 22:13:37,494 INFO [RS:2;jenkins-hbase4:38193] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-15 22:13:37,494 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 193c8a58fbee6a39e80e28b4f899ac4c 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-15 22:13:37,503 INFO [RS:2;jenkins-hbase4:38193] regionserver.HRegionServer(1474): Waiting on 3 regions to close 2023-07-15 22:13:37,503 DEBUG [RS:2;jenkins-hbase4:38193] regionserver.HRegionServer(1478): Online Regions={193c8a58fbee6a39e80e28b4f899ac4c=hbase:namespace,,1689459066320.193c8a58fbee6a39e80e28b4f899ac4c., 1588230740=hbase:meta,,1.1588230740, 1a569e443e1a4e5bb2e4d421117ad46c=hbase:acl,,1689459067073.1a569e443e1a4e5bb2e4d421117ad46c.} 2023-07-15 22:13:37,504 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-15 22:13:37,504 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-15 22:13:37,504 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-15 22:13:37,504 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-15 22:13:37,505 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-15 22:13:37,505 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-07-15 22:13:37,505 DEBUG [RS:2;jenkins-hbase4:38193] regionserver.HRegionServer(1504): Waiting on 1588230740, 193c8a58fbee6a39e80e28b4f899ac4c, 1a569e443e1a4e5bb2e4d421117ad46c 2023-07-15 22:13:37,532 DEBUG [RS:0;jenkins-hbase4:46037] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/oldWALs 2023-07-15 22:13:37,532 INFO [RS:0;jenkins-hbase4:46037] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C46037%2C1689459063224:(num 1689459065600) 2023-07-15 22:13:37,532 DEBUG [RS:0;jenkins-hbase4:46037] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 22:13:37,532 INFO [RS:0;jenkins-hbase4:46037] regionserver.LeaseManager(133): Closed leases 2023-07-15 22:13:37,533 INFO [RS:0;jenkins-hbase4:46037] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-15 22:13:37,533 INFO [RS:0;jenkins-hbase4:46037] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-15 22:13:37,533 INFO [RS:0;jenkins-hbase4:46037] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-15 22:13:37,533 INFO [RS:0;jenkins-hbase4:46037] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-15 22:13:37,534 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-15 22:13:37,539 INFO [RS:0;jenkins-hbase4:46037] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:46037 2023-07-15 22:13:37,540 DEBUG [RS:1;jenkins-hbase4:37287] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/oldWALs 2023-07-15 22:13:37,540 INFO [RS:1;jenkins-hbase4:37287] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C37287%2C1689459063311:(num 1689459065583) 2023-07-15 22:13:37,540 DEBUG [RS:1;jenkins-hbase4:37287] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 22:13:37,540 INFO [RS:1;jenkins-hbase4:37287] regionserver.LeaseManager(133): Closed leases 2023-07-15 22:13:37,542 INFO [RS:1;jenkins-hbase4:37287] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-15 22:13:37,543 INFO [RS:1;jenkins-hbase4:37287] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-15 22:13:37,543 INFO [RS:1;jenkins-hbase4:37287] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-15 22:13:37,543 INFO [RS:1;jenkins-hbase4:37287] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-15 22:13:37,543 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-15 22:13:37,545 INFO [RS:1;jenkins-hbase4:37287] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:37287 2023-07-15 22:13:37,547 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/hbase/namespace/193c8a58fbee6a39e80e28b4f899ac4c/.tmp/info/7383efe3a6e34af0a9b57e70e0bc39fb 2023-07-15 22:13:37,549 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-15 22:13:37,550 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:13:37,550 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-15 22:13:37,550 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:13:37,550 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-15 22:13:37,550 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,46037,1689459063224 2023-07-15 22:13:37,550 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-15 22:13:37,551 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:13:37,551 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:13:37,551 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37287,1689459063311 2023-07-15 22:13:37,555 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,46037,1689459063224] 2023-07-15 22:13:37,555 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-15 22:13:37,557 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,46037,1689459063224; numProcessing=1 2023-07-15 22:13:37,559 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,46037,1689459063224 already deleted, retry=false 2023-07-15 22:13:37,559 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,46037,1689459063224 expired; onlineServers=2 2023-07-15 22:13:37,559 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,37287,1689459063311] 2023-07-15 22:13:37,559 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,37287,1689459063311; numProcessing=2 2023-07-15 22:13:37,559 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/hbase/namespace/193c8a58fbee6a39e80e28b4f899ac4c/.tmp/info/7383efe3a6e34af0a9b57e70e0bc39fb as hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/hbase/namespace/193c8a58fbee6a39e80e28b4f899ac4c/info/7383efe3a6e34af0a9b57e70e0bc39fb 2023-07-15 22:13:37,559 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-15 22:13:37,560 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,37287,1689459063311 already deleted, retry=false 2023-07-15 22:13:37,560 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,37287,1689459063311 expired; onlineServers=1 2023-07-15 22:13:37,562 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-15 22:13:37,565 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/hbase/meta/1588230740/.tmp/info/a7e3af5f47f14470b092fa0a7ba5ab74 2023-07-15 22:13:37,567 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/hbase/namespace/193c8a58fbee6a39e80e28b4f899ac4c/info/7383efe3a6e34af0a9b57e70e0bc39fb, entries=2, sequenceid=6, filesize=4.8 K 2023-07-15 22:13:37,568 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 193c8a58fbee6a39e80e28b4f899ac4c in 74ms, sequenceid=6, compaction requested=false 2023-07-15 22:13:37,573 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a7e3af5f47f14470b092fa0a7ba5ab74 2023-07-15 22:13:37,576 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/hbase/namespace/193c8a58fbee6a39e80e28b4f899ac4c/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 22:13:37,577 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 22:13:37,578 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689459066320.193c8a58fbee6a39e80e28b4f899ac4c. 2023-07-15 22:13:37,578 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 193c8a58fbee6a39e80e28b4f899ac4c: 2023-07-15 22:13:37,578 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689459066320.193c8a58fbee6a39e80e28b4f899ac4c. 2023-07-15 22:13:37,579 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1a569e443e1a4e5bb2e4d421117ad46c, disabling compactions & flushes 2023-07-15 22:13:37,579 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689459067073.1a569e443e1a4e5bb2e4d421117ad46c. 2023-07-15 22:13:37,579 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689459067073.1a569e443e1a4e5bb2e4d421117ad46c. 2023-07-15 22:13:37,579 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689459067073.1a569e443e1a4e5bb2e4d421117ad46c. after waiting 0 ms 2023-07-15 22:13:37,579 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689459067073.1a569e443e1a4e5bb2e4d421117ad46c. 2023-07-15 22:13:37,579 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1a569e443e1a4e5bb2e4d421117ad46c 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-07-15 22:13:37,599 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/hbase/meta/1588230740/.tmp/rep_barrier/14d44f68fde7487eba98114fb58111d4 2023-07-15 22:13:37,603 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/hbase/acl/1a569e443e1a4e5bb2e4d421117ad46c/.tmp/l/9a92489738474dc68a4718185916e0af 2023-07-15 22:13:37,605 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 14d44f68fde7487eba98114fb58111d4 2023-07-15 22:13:37,607 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9a92489738474dc68a4718185916e0af 2023-07-15 22:13:37,608 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/hbase/acl/1a569e443e1a4e5bb2e4d421117ad46c/.tmp/l/9a92489738474dc68a4718185916e0af as hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/hbase/acl/1a569e443e1a4e5bb2e4d421117ad46c/l/9a92489738474dc68a4718185916e0af 2023-07-15 22:13:37,615 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9a92489738474dc68a4718185916e0af 2023-07-15 22:13:37,615 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/hbase/acl/1a569e443e1a4e5bb2e4d421117ad46c/l/9a92489738474dc68a4718185916e0af, entries=7, sequenceid=18, filesize=5.2 K 2023-07-15 22:13:37,616 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for 1a569e443e1a4e5bb2e4d421117ad46c in 37ms, sequenceid=18, compaction requested=false 2023-07-15 22:13:37,624 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/hbase/meta/1588230740/.tmp/table/8e703ae1114a42c09e06573cef60bbff 2023-07-15 22:13:37,624 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/hbase/acl/1a569e443e1a4e5bb2e4d421117ad46c/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-07-15 22:13:37,625 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 22:13:37,627 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1689459067073.1a569e443e1a4e5bb2e4d421117ad46c. 2023-07-15 22:13:37,627 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1a569e443e1a4e5bb2e4d421117ad46c: 2023-07-15 22:13:37,627 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1689459067073.1a569e443e1a4e5bb2e4d421117ad46c. 2023-07-15 22:13:37,629 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8e703ae1114a42c09e06573cef60bbff 2023-07-15 22:13:37,630 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/hbase/meta/1588230740/.tmp/info/a7e3af5f47f14470b092fa0a7ba5ab74 as hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/hbase/meta/1588230740/info/a7e3af5f47f14470b092fa0a7ba5ab74 2023-07-15 22:13:37,635 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a7e3af5f47f14470b092fa0a7ba5ab74 2023-07-15 22:13:37,635 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/hbase/meta/1588230740/info/a7e3af5f47f14470b092fa0a7ba5ab74, entries=48, sequenceid=131, filesize=10.3 K 2023-07-15 22:13:37,636 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/hbase/meta/1588230740/.tmp/rep_barrier/14d44f68fde7487eba98114fb58111d4 as hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/hbase/meta/1588230740/rep_barrier/14d44f68fde7487eba98114fb58111d4 2023-07-15 22:13:37,643 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 14d44f68fde7487eba98114fb58111d4 2023-07-15 22:13:37,643 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/hbase/meta/1588230740/rep_barrier/14d44f68fde7487eba98114fb58111d4, entries=13, sequenceid=131, filesize=6.4 K 2023-07-15 22:13:37,644 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/hbase/meta/1588230740/.tmp/table/8e703ae1114a42c09e06573cef60bbff as hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/hbase/meta/1588230740/table/8e703ae1114a42c09e06573cef60bbff 2023-07-15 22:13:37,652 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8e703ae1114a42c09e06573cef60bbff 2023-07-15 22:13:37,652 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/hbase/meta/1588230740/table/8e703ae1114a42c09e06573cef60bbff, entries=24, sequenceid=131, filesize=6.9 K 2023-07-15 22:13:37,655 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-15 22:13:37,655 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:37287-0x1016b09f2d10002, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-15 22:13:37,655 INFO [RS:1;jenkins-hbase4:37287] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,37287,1689459063311; zookeeper connection closed. 2023-07-15 22:13:37,659 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@528c8332] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@528c8332 2023-07-15 22:13:37,659 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 154ms, sequenceid=131, compaction requested=false 2023-07-15 22:13:37,687 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-07-15 22:13:37,688 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 22:13:37,688 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-15 22:13:37,689 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-15 22:13:37,689 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-15 22:13:37,689 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-15 22:13:37,705 INFO [RS:2;jenkins-hbase4:38193] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,38193,1689459063370; all regions closed. 2023-07-15 22:13:37,713 DEBUG [RS:2;jenkins-hbase4:38193] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/oldWALs 2023-07-15 22:13:37,713 INFO [RS:2;jenkins-hbase4:38193] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C38193%2C1689459063370.meta:.meta(num 1689459065935) 2023-07-15 22:13:37,717 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/WALs/jenkins-hbase4.apache.org,38193,1689459063370/jenkins-hbase4.apache.org%2C38193%2C1689459063370.1689459065599 not finished, retry = 0 2023-07-15 22:13:37,755 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-15 22:13:37,755 INFO [RS:0;jenkins-hbase4:46037] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,46037,1689459063224; zookeeper connection closed. 2023-07-15 22:13:37,755 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:46037-0x1016b09f2d10001, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-15 22:13:37,756 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@359c847] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@359c847 2023-07-15 22:13:37,820 DEBUG [RS:2;jenkins-hbase4:38193] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/oldWALs 2023-07-15 22:13:37,820 INFO [RS:2;jenkins-hbase4:38193] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C38193%2C1689459063370:(num 1689459065599) 2023-07-15 22:13:37,820 DEBUG [RS:2;jenkins-hbase4:38193] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 22:13:37,820 INFO [RS:2;jenkins-hbase4:38193] regionserver.LeaseManager(133): Closed leases 2023-07-15 22:13:37,820 INFO [RS:2;jenkins-hbase4:38193] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-15 22:13:37,820 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-15 22:13:37,821 INFO [RS:2;jenkins-hbase4:38193] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:38193 2023-07-15 22:13:37,829 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-15 22:13:37,829 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,38193,1689459063370 2023-07-15 22:13:37,831 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,38193,1689459063370] 2023-07-15 22:13:37,831 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,38193,1689459063370; numProcessing=3 2023-07-15 22:13:37,832 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,38193,1689459063370 already deleted, retry=false 2023-07-15 22:13:37,832 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,38193,1689459063370 expired; onlineServers=0 2023-07-15 22:13:37,832 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,42893,1689459061608' ***** 2023-07-15 22:13:37,832 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-15 22:13:37,832 DEBUG [M:0;jenkins-hbase4:42893] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4811ab1c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-15 22:13:37,832 INFO [M:0;jenkins-hbase4:42893] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,42893,1689459061608 2023-07-15 22:13:37,832 INFO [M:0;jenkins-hbase4:42893] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,42893,1689459061608; all regions closed. 2023-07-15 22:13:37,832 DEBUG [M:0;jenkins-hbase4:42893] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 22:13:37,832 DEBUG [M:0;jenkins-hbase4:42893] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-15 22:13:37,833 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-15 22:13:37,833 DEBUG [M:0;jenkins-hbase4:42893] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-15 22:13:37,833 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689459065041] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689459065041,5,FailOnTimeoutGroup] 2023-07-15 22:13:37,833 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689459065038] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689459065038,5,FailOnTimeoutGroup] 2023-07-15 22:13:37,833 INFO [M:0;jenkins-hbase4:42893] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-15 22:13:37,833 INFO [M:0;jenkins-hbase4:42893] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-15 22:13:37,833 INFO [M:0;jenkins-hbase4:42893] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-07-15 22:13:37,833 DEBUG [M:0;jenkins-hbase4:42893] master.HMaster(1512): Stopping service threads 2023-07-15 22:13:37,833 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-15 22:13:37,833 INFO [M:0;jenkins-hbase4:42893] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-15 22:13:37,833 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 22:13:37,834 ERROR [M:0;jenkins-hbase4:42893] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-07-15 22:13:37,834 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master Thread[HFileArchiver-22,5,PEWorkerGroup] Thread[HFileArchiver-23,5,PEWorkerGroup] 2023-07-15 22:13:37,834 INFO [M:0;jenkins-hbase4:42893] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-15 22:13:37,834 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-15 22:13:37,835 DEBUG [M:0;jenkins-hbase4:42893] zookeeper.ZKUtil(398): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-15 22:13:37,835 WARN [M:0;jenkins-hbase4:42893] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-15 22:13:37,835 INFO [M:0;jenkins-hbase4:42893] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-15 22:13:37,835 INFO [M:0;jenkins-hbase4:42893] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-15 22:13:37,836 DEBUG [M:0;jenkins-hbase4:42893] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-15 22:13:37,836 INFO [M:0;jenkins-hbase4:42893] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-15 22:13:37,836 DEBUG [M:0;jenkins-hbase4:42893] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-15 22:13:37,836 DEBUG [M:0;jenkins-hbase4:42893] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-15 22:13:37,836 DEBUG [M:0;jenkins-hbase4:42893] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-15 22:13:37,836 INFO [M:0;jenkins-hbase4:42893] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=373.38 KB heapSize=449.63 KB 2023-07-15 22:13:37,860 INFO [M:0;jenkins-hbase4:42893] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=373.38 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/f50c897f879b498c8c55d3a4349f93d9 2023-07-15 22:13:37,864 INFO [M:0;jenkins-hbase4:42893] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f50c897f879b498c8c55d3a4349f93d9 2023-07-15 22:13:37,865 DEBUG [M:0;jenkins-hbase4:42893] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/f50c897f879b498c8c55d3a4349f93d9 as hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/f50c897f879b498c8c55d3a4349f93d9 2023-07-15 22:13:37,870 INFO [M:0;jenkins-hbase4:42893] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f50c897f879b498c8c55d3a4349f93d9 2023-07-15 22:13:37,870 INFO [M:0;jenkins-hbase4:42893] regionserver.HStore(1080): Added hdfs://localhost:33847/user/jenkins/test-data/8929e1b5-0c66-1770-07d6-87b4d561683e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/f50c897f879b498c8c55d3a4349f93d9, entries=119, sequenceid=899, filesize=28.5 K 2023-07-15 22:13:37,871 INFO [M:0;jenkins-hbase4:42893] regionserver.HRegion(2948): Finished flush of dataSize ~373.38 KB/382340, heapSize ~449.62 KB/460408, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 35ms, sequenceid=899, compaction requested=false 2023-07-15 22:13:37,872 INFO [M:0;jenkins-hbase4:42893] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-15 22:13:37,872 DEBUG [M:0;jenkins-hbase4:42893] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-15 22:13:37,877 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-15 22:13:37,877 INFO [M:0;jenkins-hbase4:42893] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-15 22:13:37,878 INFO [M:0;jenkins-hbase4:42893] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:42893 2023-07-15 22:13:37,880 DEBUG [M:0;jenkins-hbase4:42893] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,42893,1689459061608 already deleted, retry=false 2023-07-15 22:13:37,931 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-15 22:13:37,931 INFO [RS:2;jenkins-hbase4:38193] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,38193,1689459063370; zookeeper connection closed. 2023-07-15 22:13:37,931 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): regionserver:38193-0x1016b09f2d10003, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-15 22:13:37,931 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@14ae7110] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@14ae7110 2023-07-15 22:13:37,932 INFO [Listener at jenkins-hbase4.apache.org/46535] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-15 22:13:38,031 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-15 22:13:38,031 DEBUG [Listener at localhost/35789-EventThread] zookeeper.ZKWatcher(600): master:42893-0x1016b09f2d10000, quorum=127.0.0.1:53678, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-15 22:13:38,031 INFO [M:0;jenkins-hbase4:42893] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,42893,1689459061608; zookeeper connection closed. 2023-07-15 22:13:38,034 WARN [Listener at jenkins-hbase4.apache.org/46535] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-15 22:13:38,042 INFO [Listener at jenkins-hbase4.apache.org/46535] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-15 22:13:38,043 WARN [544646839@qtp-1817471560-1 - Acceptor0 HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36429] http.HttpServer2$SelectChannelConnectorWithSafeStartup(546): HttpServer Acceptor: isRunning is false. Rechecking. 2023-07-15 22:13:38,043 WARN [544646839@qtp-1817471560-1 - Acceptor0 HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36429] http.HttpServer2$SelectChannelConnectorWithSafeStartup(555): HttpServer Acceptor: isRunning is false 2023-07-15 22:13:38,146 WARN [BP-1237247584-172.31.14.131-1689459057509 heartbeating to localhost/127.0.0.1:33847] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-15 22:13:38,146 WARN [BP-1237247584-172.31.14.131-1689459057509 heartbeating to localhost/127.0.0.1:33847] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1237247584-172.31.14.131-1689459057509 (Datanode Uuid 397b0bf6-78e5-436e-81cc-6eabfba6ae2a) service to localhost/127.0.0.1:33847 2023-07-15 22:13:38,148 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97e758c6-fe86-0ed9-092f-cd0594d33e04/cluster_fd3e249f-a612-98a2-a131-09cf78600e25/dfs/data/data5/current/BP-1237247584-172.31.14.131-1689459057509] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-15 22:13:38,148 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97e758c6-fe86-0ed9-092f-cd0594d33e04/cluster_fd3e249f-a612-98a2-a131-09cf78600e25/dfs/data/data6/current/BP-1237247584-172.31.14.131-1689459057509] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-15 22:13:38,149 WARN [Listener at jenkins-hbase4.apache.org/46535] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-15 22:13:38,152 INFO [Listener at jenkins-hbase4.apache.org/46535] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-15 22:13:38,255 WARN [BP-1237247584-172.31.14.131-1689459057509 heartbeating to localhost/127.0.0.1:33847] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-15 22:13:38,255 WARN [BP-1237247584-172.31.14.131-1689459057509 heartbeating to localhost/127.0.0.1:33847] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1237247584-172.31.14.131-1689459057509 (Datanode Uuid 412c42cc-0c54-4ab6-8f9f-9a3777441320) service to localhost/127.0.0.1:33847 2023-07-15 22:13:38,256 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97e758c6-fe86-0ed9-092f-cd0594d33e04/cluster_fd3e249f-a612-98a2-a131-09cf78600e25/dfs/data/data3/current/BP-1237247584-172.31.14.131-1689459057509] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-15 22:13:38,256 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97e758c6-fe86-0ed9-092f-cd0594d33e04/cluster_fd3e249f-a612-98a2-a131-09cf78600e25/dfs/data/data4/current/BP-1237247584-172.31.14.131-1689459057509] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-15 22:13:38,257 WARN [Listener at jenkins-hbase4.apache.org/46535] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-15 22:13:38,261 INFO [Listener at jenkins-hbase4.apache.org/46535] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-15 22:13:38,364 WARN [BP-1237247584-172.31.14.131-1689459057509 heartbeating to localhost/127.0.0.1:33847] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-15 22:13:38,364 WARN [BP-1237247584-172.31.14.131-1689459057509 heartbeating to localhost/127.0.0.1:33847] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1237247584-172.31.14.131-1689459057509 (Datanode Uuid bfe5f506-d721-4a60-8189-6ea104b7525a) service to localhost/127.0.0.1:33847 2023-07-15 22:13:38,364 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97e758c6-fe86-0ed9-092f-cd0594d33e04/cluster_fd3e249f-a612-98a2-a131-09cf78600e25/dfs/data/data1/current/BP-1237247584-172.31.14.131-1689459057509] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-15 22:13:38,365 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/97e758c6-fe86-0ed9-092f-cd0594d33e04/cluster_fd3e249f-a612-98a2-a131-09cf78600e25/dfs/data/data2/current/BP-1237247584-172.31.14.131-1689459057509] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-15 22:13:38,389 INFO [Listener at jenkins-hbase4.apache.org/46535] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-15 22:13:38,514 INFO [Listener at jenkins-hbase4.apache.org/46535] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-15 22:13:38,620 INFO [Listener at jenkins-hbase4.apache.org/46535] hbase.HBaseTestingUtility(1293): Minicluster is down