2023-07-15 16:10:47,296 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-07-15 16:10:47,559 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1587f29c-5daf-234a-1773-5088522b715e 2023-07-15 16:10:47,559 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestSecureExportSnapshot timeout: 13 mins 2023-07-15 16:10:47,599 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-15 16:10:47,893 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-15 16:10:47,894 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1587f29c-5daf-234a-1773-5088522b715e/cluster_a516de2a-eb5f-f2ef-952b-8cb73b2d461b, deleteOnExit=true 2023-07-15 16:10:47,894 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-15 16:10:47,895 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1587f29c-5daf-234a-1773-5088522b715e/test.cache.data in system properties and HBase conf 2023-07-15 16:10:47,896 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1587f29c-5daf-234a-1773-5088522b715e/hadoop.tmp.dir in system properties and HBase conf 2023-07-15 16:10:47,896 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1587f29c-5daf-234a-1773-5088522b715e/hadoop.log.dir in system properties and HBase conf 2023-07-15 16:10:47,897 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1587f29c-5daf-234a-1773-5088522b715e/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-15 16:10:47,897 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1587f29c-5daf-234a-1773-5088522b715e/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-15 16:10:47,898 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-15 16:10:48,359 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-15 16:10:48,364 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1587f29c-5daf-234a-1773-5088522b715e/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-15 16:10:48,364 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1587f29c-5daf-234a-1773-5088522b715e/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-15 16:10:48,364 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1587f29c-5daf-234a-1773-5088522b715e/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-15 16:10:48,365 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1587f29c-5daf-234a-1773-5088522b715e/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-15 16:10:48,365 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1587f29c-5daf-234a-1773-5088522b715e/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-15 16:10:48,366 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1587f29c-5daf-234a-1773-5088522b715e/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-15 16:10:48,366 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1587f29c-5daf-234a-1773-5088522b715e/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-15 16:10:48,367 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1587f29c-5daf-234a-1773-5088522b715e/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-15 16:10:48,367 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1587f29c-5daf-234a-1773-5088522b715e/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-15 16:10:48,367 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1587f29c-5daf-234a-1773-5088522b715e/nfs.dump.dir in system properties and HBase conf 2023-07-15 16:10:48,368 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1587f29c-5daf-234a-1773-5088522b715e/java.io.tmpdir in system properties and HBase conf 2023-07-15 16:10:48,368 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1587f29c-5daf-234a-1773-5088522b715e/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-15 16:10:48,369 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1587f29c-5daf-234a-1773-5088522b715e/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-15 16:10:48,369 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1587f29c-5daf-234a-1773-5088522b715e/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-15 16:10:48,998 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-15 16:10:49,004 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-15 16:10:49,344 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-15 16:10:49,567 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-15 16:10:49,582 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-15 16:10:49,624 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-15 16:10:49,658 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1587f29c-5daf-234a-1773-5088522b715e/java.io.tmpdir/Jetty_localhost_33011_hdfs____mo363e/webapp 2023-07-15 16:10:49,824 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33011 2023-07-15 16:10:49,839 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-15 16:10:49,839 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-15 16:10:50,413 WARN [Listener at localhost/44749] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-15 16:10:50,509 WARN [Listener at localhost/44749] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-15 16:10:50,532 WARN [Listener at localhost/44749] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-15 16:10:50,598 INFO [Listener at localhost/44749] log.Slf4jLog(67): jetty-6.1.26 2023-07-15 16:10:50,610 INFO [Listener at localhost/44749] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1587f29c-5daf-234a-1773-5088522b715e/java.io.tmpdir/Jetty_localhost_38299_datanode____.3s5rgs/webapp 2023-07-15 16:10:50,743 INFO [Listener at localhost/44749] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38299 2023-07-15 16:10:51,269 WARN [Listener at localhost/41015] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-15 16:10:51,302 WARN [Listener at localhost/41015] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-15 16:10:51,307 WARN [Listener at localhost/41015] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-15 16:10:51,309 INFO [Listener at localhost/41015] log.Slf4jLog(67): jetty-6.1.26 2023-07-15 16:10:51,322 INFO [Listener at localhost/41015] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1587f29c-5daf-234a-1773-5088522b715e/java.io.tmpdir/Jetty_localhost_39215_datanode____31h8yf/webapp 2023-07-15 16:10:51,444 INFO [Listener at localhost/41015] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39215 2023-07-15 16:10:51,462 WARN [Listener at localhost/43023] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-15 16:10:51,519 WARN [Listener at localhost/43023] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-15 16:10:51,523 WARN [Listener at localhost/43023] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-15 16:10:51,525 INFO [Listener at localhost/43023] log.Slf4jLog(67): jetty-6.1.26 2023-07-15 16:10:51,538 INFO [Listener at localhost/43023] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1587f29c-5daf-234a-1773-5088522b715e/java.io.tmpdir/Jetty_localhost_41511_datanode____.px1uw1/webapp 2023-07-15 16:10:51,697 INFO [Listener at localhost/43023] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41511 2023-07-15 16:10:51,738 WARN [Listener at localhost/39933] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-15 16:10:52,109 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xbc6854c061565992: Processing first storage report for DS-51f6c124-b0bf-4f3a-873d-f10f54d0b558 from datanode b7deca30-a95f-4869-8e90-835069b76877 2023-07-15 16:10:52,111 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xbc6854c061565992: from storage DS-51f6c124-b0bf-4f3a-873d-f10f54d0b558 node DatanodeRegistration(127.0.0.1:34473, datanodeUuid=b7deca30-a95f-4869-8e90-835069b76877, infoPort=34957, infoSecurePort=0, ipcPort=43023, storageInfo=lv=-57;cid=testClusterID;nsid=368339199;c=1689437449095), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-07-15 16:10:52,112 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xe7d38d9caafa1179: Processing first storage report for DS-a9295281-d0c9-4e01-8acb-71c0417d0769 from datanode 0ad7c7c4-50ec-4659-b4ad-156e303fbe00 2023-07-15 16:10:52,112 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xe7d38d9caafa1179: from storage DS-a9295281-d0c9-4e01-8acb-71c0417d0769 node DatanodeRegistration(127.0.0.1:33583, datanodeUuid=0ad7c7c4-50ec-4659-b4ad-156e303fbe00, infoPort=43665, infoSecurePort=0, ipcPort=39933, storageInfo=lv=-57;cid=testClusterID;nsid=368339199;c=1689437449095), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-15 16:10:52,112 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x1fa546f46e4bb724: Processing first storage report for DS-a8e9ee18-efc4-4437-92ee-4662c4af3981 from datanode 999def7e-56c6-49a0-96e0-35ca7ef0c310 2023-07-15 16:10:52,112 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x1fa546f46e4bb724: from storage DS-a8e9ee18-efc4-4437-92ee-4662c4af3981 node DatanodeRegistration(127.0.0.1:44881, datanodeUuid=999def7e-56c6-49a0-96e0-35ca7ef0c310, infoPort=39863, infoSecurePort=0, ipcPort=41015, storageInfo=lv=-57;cid=testClusterID;nsid=368339199;c=1689437449095), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-15 16:10:52,112 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xbc6854c061565992: Processing first storage report for DS-dc126792-17eb-4184-875a-c5b4cc76165f from datanode b7deca30-a95f-4869-8e90-835069b76877 2023-07-15 16:10:52,112 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xbc6854c061565992: from storage DS-dc126792-17eb-4184-875a-c5b4cc76165f node DatanodeRegistration(127.0.0.1:34473, datanodeUuid=b7deca30-a95f-4869-8e90-835069b76877, infoPort=34957, infoSecurePort=0, ipcPort=43023, storageInfo=lv=-57;cid=testClusterID;nsid=368339199;c=1689437449095), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-15 16:10:52,113 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xe7d38d9caafa1179: Processing first storage report for DS-08ccee73-065f-4cc6-a08d-de2f2df412a9 from datanode 0ad7c7c4-50ec-4659-b4ad-156e303fbe00 2023-07-15 16:10:52,113 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xe7d38d9caafa1179: from storage DS-08ccee73-065f-4cc6-a08d-de2f2df412a9 node DatanodeRegistration(127.0.0.1:33583, datanodeUuid=0ad7c7c4-50ec-4659-b4ad-156e303fbe00, infoPort=43665, infoSecurePort=0, ipcPort=39933, storageInfo=lv=-57;cid=testClusterID;nsid=368339199;c=1689437449095), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-15 16:10:52,113 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x1fa546f46e4bb724: Processing first storage report for DS-0447713b-562f-4555-81ac-aaab10170b21 from datanode 999def7e-56c6-49a0-96e0-35ca7ef0c310 2023-07-15 16:10:52,113 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x1fa546f46e4bb724: from storage DS-0447713b-562f-4555-81ac-aaab10170b21 node DatanodeRegistration(127.0.0.1:44881, datanodeUuid=999def7e-56c6-49a0-96e0-35ca7ef0c310, infoPort=39863, infoSecurePort=0, ipcPort=41015, storageInfo=lv=-57;cid=testClusterID;nsid=368339199;c=1689437449095), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-15 16:10:52,376 DEBUG [Listener at localhost/39933] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1587f29c-5daf-234a-1773-5088522b715e 2023-07-15 16:10:52,470 INFO [Listener at localhost/39933] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1587f29c-5daf-234a-1773-5088522b715e/cluster_a516de2a-eb5f-f2ef-952b-8cb73b2d461b/zookeeper_0, clientPort=58438, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1587f29c-5daf-234a-1773-5088522b715e/cluster_a516de2a-eb5f-f2ef-952b-8cb73b2d461b/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1587f29c-5daf-234a-1773-5088522b715e/cluster_a516de2a-eb5f-f2ef-952b-8cb73b2d461b/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-15 16:10:52,496 INFO [Listener at localhost/39933] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=58438 2023-07-15 16:10:52,506 INFO [Listener at localhost/39933] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 16:10:52,509 INFO [Listener at localhost/39933] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 16:10:53,244 INFO [Listener at localhost/39933] util.FSUtils(471): Created version file at hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8 with version=8 2023-07-15 16:10:53,245 INFO [Listener at localhost/39933] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/hbase-staging 2023-07-15 16:10:53,639 INFO [Listener at localhost/39933] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-15 16:10:54,226 INFO [Listener at localhost/39933] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-07-15 16:10:54,277 INFO [Listener at localhost/39933] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-15 16:10:54,277 INFO [Listener at localhost/39933] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-15 16:10:54,278 INFO [Listener at localhost/39933] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-15 16:10:54,278 INFO [Listener at localhost/39933] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-15 16:10:54,278 INFO [Listener at localhost/39933] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-15 16:10:54,444 INFO [Listener at localhost/39933] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-15 16:10:54,535 DEBUG [Listener at localhost/39933] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-15 16:10:54,645 INFO [Listener at localhost/39933] ipc.NettyRpcServer(120): Bind to /172.31.14.131:37255 2023-07-15 16:10:54,660 INFO [Listener at localhost/39933] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 16:10:54,662 INFO [Listener at localhost/39933] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 16:10:54,690 INFO [Listener at localhost/39933] zookeeper.RecoverableZooKeeper(93): Process identifier=master:37255 connecting to ZooKeeper ensemble=127.0.0.1:58438 2023-07-15 16:10:54,750 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:372550x0, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-15 16:10:54,754 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:37255-0x10169c03b9e0000 connected 2023-07-15 16:10:54,788 DEBUG [Listener at localhost/39933] zookeeper.ZKUtil(164): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-15 16:10:54,789 DEBUG [Listener at localhost/39933] zookeeper.ZKUtil(164): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-15 16:10:54,804 DEBUG [Listener at localhost/39933] zookeeper.ZKUtil(164): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-15 16:10:54,813 DEBUG [Listener at localhost/39933] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37255 2023-07-15 16:10:54,814 DEBUG [Listener at localhost/39933] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37255 2023-07-15 16:10:54,815 DEBUG [Listener at localhost/39933] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37255 2023-07-15 16:10:54,816 DEBUG [Listener at localhost/39933] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37255 2023-07-15 16:10:54,816 DEBUG [Listener at localhost/39933] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37255 2023-07-15 16:10:54,823 INFO [Listener at localhost/39933] master.HMaster(444): hbase.rootdir=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8, hbase.cluster.distributed=false 2023-07-15 16:10:54,905 INFO [Listener at localhost/39933] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-15 16:10:54,906 INFO [Listener at localhost/39933] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-15 16:10:54,906 INFO [Listener at localhost/39933] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-15 16:10:54,906 INFO [Listener at localhost/39933] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-15 16:10:54,906 INFO [Listener at localhost/39933] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-15 16:10:54,906 INFO [Listener at localhost/39933] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-15 16:10:54,911 INFO [Listener at localhost/39933] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-15 16:10:54,923 INFO [Listener at localhost/39933] ipc.NettyRpcServer(120): Bind to /172.31.14.131:43103 2023-07-15 16:10:54,927 INFO [Listener at localhost/39933] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-15 16:10:54,937 DEBUG [Listener at localhost/39933] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-15 16:10:54,939 INFO [Listener at localhost/39933] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 16:10:54,941 INFO [Listener at localhost/39933] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 16:10:54,944 INFO [Listener at localhost/39933] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:43103 connecting to ZooKeeper ensemble=127.0.0.1:58438 2023-07-15 16:10:54,960 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:431030x0, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-15 16:10:54,961 DEBUG [Listener at localhost/39933] zookeeper.ZKUtil(164): regionserver:431030x0, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-15 16:10:54,964 DEBUG [Listener at localhost/39933] zookeeper.ZKUtil(164): regionserver:431030x0, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-15 16:10:54,964 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:43103-0x10169c03b9e0001 connected 2023-07-15 16:10:54,966 DEBUG [Listener at localhost/39933] zookeeper.ZKUtil(164): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-15 16:10:54,971 DEBUG [Listener at localhost/39933] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43103 2023-07-15 16:10:54,972 DEBUG [Listener at localhost/39933] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43103 2023-07-15 16:10:54,972 DEBUG [Listener at localhost/39933] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43103 2023-07-15 16:10:54,974 DEBUG [Listener at localhost/39933] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43103 2023-07-15 16:10:54,974 DEBUG [Listener at localhost/39933] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43103 2023-07-15 16:10:54,991 INFO [Listener at localhost/39933] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-15 16:10:54,991 INFO [Listener at localhost/39933] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-15 16:10:54,992 INFO [Listener at localhost/39933] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-15 16:10:54,992 INFO [Listener at localhost/39933] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-15 16:10:54,993 INFO [Listener at localhost/39933] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-15 16:10:54,993 INFO [Listener at localhost/39933] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-15 16:10:54,993 INFO [Listener at localhost/39933] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-15 16:10:54,996 INFO [Listener at localhost/39933] ipc.NettyRpcServer(120): Bind to /172.31.14.131:35773 2023-07-15 16:10:54,996 INFO [Listener at localhost/39933] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-15 16:10:54,998 DEBUG [Listener at localhost/39933] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-15 16:10:54,999 INFO [Listener at localhost/39933] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 16:10:55,002 INFO [Listener at localhost/39933] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 16:10:55,005 INFO [Listener at localhost/39933] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:35773 connecting to ZooKeeper ensemble=127.0.0.1:58438 2023-07-15 16:10:55,023 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:357730x0, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-15 16:10:55,024 DEBUG [Listener at localhost/39933] zookeeper.ZKUtil(164): regionserver:357730x0, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-15 16:10:55,025 DEBUG [Listener at localhost/39933] zookeeper.ZKUtil(164): regionserver:357730x0, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-15 16:10:55,026 DEBUG [Listener at localhost/39933] zookeeper.ZKUtil(164): regionserver:357730x0, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-15 16:10:55,027 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:35773-0x10169c03b9e0002 connected 2023-07-15 16:10:55,033 DEBUG [Listener at localhost/39933] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35773 2023-07-15 16:10:55,039 DEBUG [Listener at localhost/39933] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35773 2023-07-15 16:10:55,042 DEBUG [Listener at localhost/39933] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35773 2023-07-15 16:10:55,047 DEBUG [Listener at localhost/39933] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35773 2023-07-15 16:10:55,050 DEBUG [Listener at localhost/39933] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35773 2023-07-15 16:10:55,063 INFO [Listener at localhost/39933] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-15 16:10:55,063 INFO [Listener at localhost/39933] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-15 16:10:55,063 INFO [Listener at localhost/39933] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-15 16:10:55,064 INFO [Listener at localhost/39933] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-15 16:10:55,064 INFO [Listener at localhost/39933] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-15 16:10:55,064 INFO [Listener at localhost/39933] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-15 16:10:55,064 INFO [Listener at localhost/39933] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-15 16:10:55,067 INFO [Listener at localhost/39933] ipc.NettyRpcServer(120): Bind to /172.31.14.131:45149 2023-07-15 16:10:55,068 INFO [Listener at localhost/39933] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-15 16:10:55,072 DEBUG [Listener at localhost/39933] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-15 16:10:55,074 INFO [Listener at localhost/39933] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 16:10:55,076 INFO [Listener at localhost/39933] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 16:10:55,077 INFO [Listener at localhost/39933] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:45149 connecting to ZooKeeper ensemble=127.0.0.1:58438 2023-07-15 16:10:55,086 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:451490x0, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-15 16:10:55,088 DEBUG [Listener at localhost/39933] zookeeper.ZKUtil(164): regionserver:451490x0, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-15 16:10:55,089 DEBUG [Listener at localhost/39933] zookeeper.ZKUtil(164): regionserver:451490x0, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-15 16:10:55,090 DEBUG [Listener at localhost/39933] zookeeper.ZKUtil(164): regionserver:451490x0, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-15 16:10:55,095 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:45149-0x10169c03b9e0003 connected 2023-07-15 16:10:55,111 DEBUG [Listener at localhost/39933] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45149 2023-07-15 16:10:55,114 DEBUG [Listener at localhost/39933] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45149 2023-07-15 16:10:55,115 DEBUG [Listener at localhost/39933] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45149 2023-07-15 16:10:55,116 DEBUG [Listener at localhost/39933] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45149 2023-07-15 16:10:55,117 DEBUG [Listener at localhost/39933] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45149 2023-07-15 16:10:55,135 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,37255,1689437453412 2023-07-15 16:10:55,151 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-15 16:10:55,157 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,37255,1689437453412 2023-07-15 16:10:55,184 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-15 16:10:55,184 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-15 16:10:55,186 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-15 16:10:55,186 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-15 16:10:55,187 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 16:10:55,191 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-15 16:10:55,194 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,37255,1689437453412 from backup master directory 2023-07-15 16:10:55,194 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-15 16:10:55,198 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,37255,1689437453412 2023-07-15 16:10:55,198 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-15 16:10:55,200 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-15 16:10:55,201 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,37255,1689437453412 2023-07-15 16:10:55,205 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-15 16:10:55,211 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-15 16:10:55,341 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/hbase.id with ID: edecf17b-16d4-4bbe-b488-6c6375ebe0e7 2023-07-15 16:10:55,401 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 16:10:55,420 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 16:10:55,483 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x768fd43d to 127.0.0.1:58438 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 16:10:55,530 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@84422ed, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 16:10:55,565 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-15 16:10:55,567 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-15 16:10:55,591 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-15 16:10:55,591 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-15 16:10:55,594 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-15 16:10:55,598 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-15 16:10:55,600 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-15 16:10:55,639 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/MasterData/data/master/store-tmp 2023-07-15 16:10:55,699 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 16:10:55,702 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-15 16:10:55,703 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-15 16:10:55,703 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-15 16:10:55,703 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-15 16:10:55,703 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-15 16:10:55,703 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-15 16:10:55,703 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-15 16:10:55,706 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/MasterData/WALs/jenkins-hbase4.apache.org,37255,1689437453412 2023-07-15 16:10:55,737 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37255%2C1689437453412, suffix=, logDir=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/MasterData/WALs/jenkins-hbase4.apache.org,37255,1689437453412, archiveDir=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/MasterData/oldWALs, maxLogs=10 2023-07-15 16:10:55,814 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44881,DS-a8e9ee18-efc4-4437-92ee-4662c4af3981,DISK] 2023-07-15 16:10:55,814 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34473,DS-51f6c124-b0bf-4f3a-873d-f10f54d0b558,DISK] 2023-07-15 16:10:55,814 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33583,DS-a9295281-d0c9-4e01-8acb-71c0417d0769,DISK] 2023-07-15 16:10:55,823 DEBUG [RS-EventLoopGroup-5-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-15 16:10:55,928 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/MasterData/WALs/jenkins-hbase4.apache.org,37255,1689437453412/jenkins-hbase4.apache.org%2C37255%2C1689437453412.1689437455754 2023-07-15 16:10:55,929 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34473,DS-51f6c124-b0bf-4f3a-873d-f10f54d0b558,DISK], DatanodeInfoWithStorage[127.0.0.1:44881,DS-a8e9ee18-efc4-4437-92ee-4662c4af3981,DISK], DatanodeInfoWithStorage[127.0.0.1:33583,DS-a9295281-d0c9-4e01-8acb-71c0417d0769,DISK]] 2023-07-15 16:10:55,930 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-15 16:10:55,930 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 16:10:55,935 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-15 16:10:55,936 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-15 16:10:56,032 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-15 16:10:56,043 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-15 16:10:56,100 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-15 16:10:56,117 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 16:10:56,124 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-15 16:10:56,126 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-15 16:10:56,145 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-15 16:10:56,150 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 16:10:56,151 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71260573, jitterRate=0.06186528503894806}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 16:10:56,152 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-15 16:10:56,154 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-15 16:10:56,187 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-15 16:10:56,187 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-15 16:10:56,191 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-15 16:10:56,193 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-15 16:10:56,237 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 44 msec 2023-07-15 16:10:56,238 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-15 16:10:56,270 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-15 16:10:56,279 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-15 16:10:56,311 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-15 16:10:56,318 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-15 16:10:56,320 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-15 16:10:56,326 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-15 16:10:56,332 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-15 16:10:56,335 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 16:10:56,337 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-15 16:10:56,338 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-15 16:10:56,353 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-15 16:10:56,357 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-15 16:10:56,357 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-15 16:10:56,357 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-15 16:10:56,357 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-15 16:10:56,357 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 16:10:56,359 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,37255,1689437453412, sessionid=0x10169c03b9e0000, setting cluster-up flag (Was=false) 2023-07-15 16:10:56,382 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 16:10:56,388 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-15 16:10:56,392 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,37255,1689437453412 2023-07-15 16:10:56,400 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 16:10:56,406 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-15 16:10:56,407 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,37255,1689437453412 2023-07-15 16:10:56,411 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.hbase-snapshot/.tmp 2023-07-15 16:10:56,426 INFO [RS:0;jenkins-hbase4:43103] regionserver.HRegionServer(951): ClusterId : edecf17b-16d4-4bbe-b488-6c6375ebe0e7 2023-07-15 16:10:56,429 INFO [RS:1;jenkins-hbase4:35773] regionserver.HRegionServer(951): ClusterId : edecf17b-16d4-4bbe-b488-6c6375ebe0e7 2023-07-15 16:10:56,435 INFO [RS:2;jenkins-hbase4:45149] regionserver.HRegionServer(951): ClusterId : edecf17b-16d4-4bbe-b488-6c6375ebe0e7 2023-07-15 16:10:56,440 DEBUG [RS:0;jenkins-hbase4:43103] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-15 16:10:56,440 DEBUG [RS:1;jenkins-hbase4:35773] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-15 16:10:56,440 DEBUG [RS:2;jenkins-hbase4:45149] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-15 16:10:56,459 DEBUG [RS:1;jenkins-hbase4:35773] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-15 16:10:56,460 DEBUG [RS:1;jenkins-hbase4:35773] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-15 16:10:56,463 DEBUG [RS:0;jenkins-hbase4:43103] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-15 16:10:56,463 DEBUG [RS:0;jenkins-hbase4:43103] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-15 16:10:56,463 DEBUG [RS:1;jenkins-hbase4:35773] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-15 16:10:56,464 DEBUG [RS:1;jenkins-hbase4:35773] zookeeper.ReadOnlyZKClient(139): Connect 0x6aa55d4b to 127.0.0.1:58438 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 16:10:56,467 DEBUG [RS:2;jenkins-hbase4:45149] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-15 16:10:56,467 DEBUG [RS:2;jenkins-hbase4:45149] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-15 16:10:56,472 DEBUG [RS:0;jenkins-hbase4:43103] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-15 16:10:56,472 DEBUG [RS:2;jenkins-hbase4:45149] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-15 16:10:56,476 DEBUG [RS:0;jenkins-hbase4:43103] zookeeper.ReadOnlyZKClient(139): Connect 0x11ec4c41 to 127.0.0.1:58438 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 16:10:56,477 DEBUG [RS:2;jenkins-hbase4:45149] zookeeper.ReadOnlyZKClient(139): Connect 0x1c3961ab to 127.0.0.1:58438 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 16:10:56,494 DEBUG [RS:1;jenkins-hbase4:35773] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6462ae6f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 16:10:56,495 DEBUG [RS:1;jenkins-hbase4:35773] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@605d363b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-15 16:10:56,504 DEBUG [RS:0;jenkins-hbase4:43103] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1f2bb00c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 16:10:56,504 DEBUG [RS:0;jenkins-hbase4:43103] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1b142731, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-15 16:10:56,555 DEBUG [RS:2;jenkins-hbase4:45149] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@12fe8c5c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 16:10:56,555 DEBUG [RS:2;jenkins-hbase4:45149] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@16c10adb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-15 16:10:56,577 DEBUG [RS:0;jenkins-hbase4:43103] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:43103 2023-07-15 16:10:56,577 DEBUG [RS:2;jenkins-hbase4:45149] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:45149 2023-07-15 16:10:56,577 DEBUG [RS:1;jenkins-hbase4:35773] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:35773 2023-07-15 16:10:56,584 INFO [RS:1;jenkins-hbase4:35773] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-15 16:10:56,584 INFO [RS:1;jenkins-hbase4:35773] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-15 16:10:56,584 INFO [RS:2;jenkins-hbase4:45149] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-15 16:10:56,586 INFO [RS:2;jenkins-hbase4:45149] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-15 16:10:56,584 INFO [RS:0;jenkins-hbase4:43103] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-15 16:10:56,587 INFO [RS:0;jenkins-hbase4:43103] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-15 16:10:56,593 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-15 16:10:56,593 DEBUG [RS:1;jenkins-hbase4:35773] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-15 16:10:56,593 DEBUG [RS:2;jenkins-hbase4:45149] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-15 16:10:56,593 DEBUG [RS:0;jenkins-hbase4:43103] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-15 16:10:56,595 INFO [RS:1;jenkins-hbase4:35773] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 16:10:56,595 INFO [RS:2;jenkins-hbase4:45149] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 16:10:56,598 DEBUG [RS:1;jenkins-hbase4:35773] regionserver.HRegionServer(1022): About to register with Master. 2023-07-15 16:10:56,598 DEBUG [RS:2;jenkins-hbase4:45149] regionserver.HRegionServer(1022): About to register with Master. 2023-07-15 16:10:56,598 INFO [RS:0;jenkins-hbase4:43103] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 16:10:56,599 DEBUG [RS:0;jenkins-hbase4:43103] regionserver.HRegionServer(1022): About to register with Master. 2023-07-15 16:10:56,595 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 16:10:56,600 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-15 16:10:56,601 INFO [RS:1;jenkins-hbase4:35773] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,37255,1689437453412 with isa=jenkins-hbase4.apache.org/172.31.14.131:35773, startcode=1689437454990 2023-07-15 16:10:56,601 INFO [RS:2;jenkins-hbase4:45149] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,37255,1689437453412 with isa=jenkins-hbase4.apache.org/172.31.14.131:45149, startcode=1689437455062 2023-07-15 16:10:56,607 INFO [RS:0;jenkins-hbase4:43103] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,37255,1689437453412 with isa=jenkins-hbase4.apache.org/172.31.14.131:43103, startcode=1689437454905 2023-07-15 16:10:56,623 DEBUG [RS:1;jenkins-hbase4:35773] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-15 16:10:56,624 DEBUG [RS:2;jenkins-hbase4:45149] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-15 16:10:56,623 DEBUG [RS:0;jenkins-hbase4:43103] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-15 16:10:56,701 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49563, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-15 16:10:56,701 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41371, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-15 16:10:56,701 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47979, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-15 16:10:56,711 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-15 16:10:56,711 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37255] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-15 16:10:56,722 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37255] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-15 16:10:56,724 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37255] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-15 16:10:56,728 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-15 16:10:56,728 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-15 16:10:56,744 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-15 16:10:56,744 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-15 16:10:56,744 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-07-15 16:10:56,744 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 16:10:56,744 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-15 16:10:56,744 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 16:10:56,777 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689437486777 2023-07-15 16:10:56,780 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-15 16:10:56,793 DEBUG [RS:1;jenkins-hbase4:35773] regionserver.HRegionServer(2830): Master is not running yet 2023-07-15 16:10:56,793 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-15 16:10:56,793 WARN [RS:1;jenkins-hbase4:35773] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-15 16:10:56,793 DEBUG [RS:0;jenkins-hbase4:43103] regionserver.HRegionServer(2830): Master is not running yet 2023-07-15 16:10:56,793 DEBUG [RS:2;jenkins-hbase4:45149] regionserver.HRegionServer(2830): Master is not running yet 2023-07-15 16:10:56,793 WARN [RS:0;jenkins-hbase4:43103] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-15 16:10:56,793 WARN [RS:2;jenkins-hbase4:45149] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-15 16:10:56,794 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-15 16:10:56,796 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-15 16:10:56,799 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-15 16:10:56,805 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-15 16:10:56,806 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-15 16:10:56,806 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-15 16:10:56,806 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-15 16:10:56,811 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-15 16:10:56,813 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-15 16:10:56,815 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-15 16:10:56,816 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-15 16:10:56,820 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-15 16:10:56,822 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-15 16:10:56,825 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689437456825,5,FailOnTimeoutGroup] 2023-07-15 16:10:56,825 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689437456825,5,FailOnTimeoutGroup] 2023-07-15 16:10:56,826 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-15 16:10:56,826 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-15 16:10:56,827 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-15 16:10:56,829 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-15 16:10:56,860 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-15 16:10:56,862 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-15 16:10:56,863 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8 2023-07-15 16:10:56,893 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 16:10:56,894 INFO [RS:1;jenkins-hbase4:35773] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,37255,1689437453412 with isa=jenkins-hbase4.apache.org/172.31.14.131:35773, startcode=1689437454990 2023-07-15 16:10:56,895 INFO [RS:2;jenkins-hbase4:45149] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,37255,1689437453412 with isa=jenkins-hbase4.apache.org/172.31.14.131:45149, startcode=1689437455062 2023-07-15 16:10:56,895 INFO [RS:0;jenkins-hbase4:43103] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,37255,1689437453412 with isa=jenkins-hbase4.apache.org/172.31.14.131:43103, startcode=1689437454905 2023-07-15 16:10:56,896 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-15 16:10:56,901 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/hbase/meta/1588230740/info 2023-07-15 16:10:56,902 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-15 16:10:56,903 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37255] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:10:56,904 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 16:10:56,907 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-15 16:10:56,910 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37255] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:10:56,911 DEBUG [RS:1;jenkins-hbase4:35773] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8 2023-07-15 16:10:56,911 DEBUG [RS:1;jenkins-hbase4:35773] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:44749 2023-07-15 16:10:56,911 DEBUG [RS:1;jenkins-hbase4:35773] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-15 16:10:56,915 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37255] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:10:56,916 DEBUG [RS:0;jenkins-hbase4:43103] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8 2023-07-15 16:10:56,916 DEBUG [RS:0;jenkins-hbase4:43103] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:44749 2023-07-15 16:10:56,916 DEBUG [RS:0;jenkins-hbase4:43103] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-15 16:10:56,917 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/hbase/meta/1588230740/rep_barrier 2023-07-15 16:10:56,917 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-15 16:10:56,919 DEBUG [RS:2;jenkins-hbase4:45149] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8 2023-07-15 16:10:56,919 DEBUG [RS:2;jenkins-hbase4:45149] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:44749 2023-07-15 16:10:56,919 DEBUG [RS:2;jenkins-hbase4:45149] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-15 16:10:56,919 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-15 16:10:56,920 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 16:10:56,921 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-15 16:10:56,924 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/hbase/meta/1588230740/table 2023-07-15 16:10:56,924 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-15 16:10:56,926 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 16:10:56,927 DEBUG [RS:1;jenkins-hbase4:35773] zookeeper.ZKUtil(162): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:10:56,927 WARN [RS:1;jenkins-hbase4:35773] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-15 16:10:56,927 INFO [RS:1;jenkins-hbase4:35773] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-15 16:10:56,928 DEBUG [RS:1;jenkins-hbase4:35773] regionserver.HRegionServer(1948): logDir=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/WALs/jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:10:56,933 DEBUG [RS:0;jenkins-hbase4:43103] zookeeper.ZKUtil(162): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:10:56,933 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,35773,1689437454990] 2023-07-15 16:10:56,933 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,45149,1689437455062] 2023-07-15 16:10:56,933 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,43103,1689437454905] 2023-07-15 16:10:56,933 DEBUG [RS:2;jenkins-hbase4:45149] zookeeper.ZKUtil(162): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:10:56,933 WARN [RS:0;jenkins-hbase4:43103] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-15 16:10:56,933 WARN [RS:2;jenkins-hbase4:45149] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-15 16:10:56,935 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/hbase/meta/1588230740 2023-07-15 16:10:56,936 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/hbase/meta/1588230740 2023-07-15 16:10:56,941 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-15 16:10:56,943 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-15 16:10:56,934 INFO [RS:0;jenkins-hbase4:43103] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-15 16:10:56,935 INFO [RS:2;jenkins-hbase4:45149] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-15 16:10:56,947 DEBUG [RS:0;jenkins-hbase4:43103] regionserver.HRegionServer(1948): logDir=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/WALs/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:10:56,947 DEBUG [RS:2;jenkins-hbase4:45149] regionserver.HRegionServer(1948): logDir=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/WALs/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:10:56,954 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 16:10:56,960 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63515696, jitterRate=-0.053542375564575195}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-15 16:10:56,960 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-15 16:10:56,960 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-15 16:10:56,960 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-15 16:10:56,960 DEBUG [RS:1;jenkins-hbase4:35773] zookeeper.ZKUtil(162): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:10:56,961 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-15 16:10:56,961 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-15 16:10:56,961 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-15 16:10:56,961 DEBUG [RS:1;jenkins-hbase4:35773] zookeeper.ZKUtil(162): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:10:56,962 DEBUG [RS:1;jenkins-hbase4:35773] zookeeper.ZKUtil(162): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:10:56,968 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-15 16:10:56,968 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-15 16:10:56,975 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-15 16:10:56,975 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-15 16:10:56,976 DEBUG [RS:2;jenkins-hbase4:45149] zookeeper.ZKUtil(162): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:10:56,976 DEBUG [RS:2;jenkins-hbase4:45149] zookeeper.ZKUtil(162): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:10:56,976 DEBUG [RS:0;jenkins-hbase4:43103] zookeeper.ZKUtil(162): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:10:56,977 DEBUG [RS:2;jenkins-hbase4:45149] zookeeper.ZKUtil(162): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:10:56,977 DEBUG [RS:0;jenkins-hbase4:43103] zookeeper.ZKUtil(162): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:10:56,978 DEBUG [RS:0;jenkins-hbase4:43103] zookeeper.ZKUtil(162): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:10:56,980 DEBUG [RS:0;jenkins-hbase4:43103] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-15 16:10:56,980 DEBUG [RS:2;jenkins-hbase4:45149] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-15 16:10:56,983 DEBUG [RS:1;jenkins-hbase4:35773] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-15 16:10:56,989 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-15 16:10:56,994 INFO [RS:0;jenkins-hbase4:43103] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-15 16:10:56,994 INFO [RS:2;jenkins-hbase4:45149] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-15 16:10:56,995 INFO [RS:1;jenkins-hbase4:35773] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-15 16:10:57,006 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-15 16:10:57,011 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-15 16:10:57,022 INFO [RS:1;jenkins-hbase4:35773] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-15 16:10:57,023 INFO [RS:2;jenkins-hbase4:45149] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-15 16:10:57,024 INFO [RS:0;jenkins-hbase4:43103] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-15 16:10:57,027 INFO [RS:1;jenkins-hbase4:35773] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-15 16:10:57,028 INFO [RS:0;jenkins-hbase4:43103] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-15 16:10:57,028 INFO [RS:1;jenkins-hbase4:35773] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-15 16:10:57,028 INFO [RS:0;jenkins-hbase4:43103] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-15 16:10:57,027 INFO [RS:2;jenkins-hbase4:45149] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-15 16:10:57,029 INFO [RS:2;jenkins-hbase4:45149] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-15 16:10:57,029 INFO [RS:1;jenkins-hbase4:35773] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-15 16:10:57,029 INFO [RS:2;jenkins-hbase4:45149] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-15 16:10:57,031 INFO [RS:0;jenkins-hbase4:43103] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-15 16:10:57,040 INFO [RS:0;jenkins-hbase4:43103] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-15 16:10:57,040 INFO [RS:2;jenkins-hbase4:45149] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-15 16:10:57,040 INFO [RS:1;jenkins-hbase4:35773] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-15 16:10:57,040 DEBUG [RS:0;jenkins-hbase4:43103] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 16:10:57,041 DEBUG [RS:2;jenkins-hbase4:45149] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 16:10:57,041 DEBUG [RS:1;jenkins-hbase4:35773] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 16:10:57,041 DEBUG [RS:2;jenkins-hbase4:45149] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 16:10:57,041 DEBUG [RS:0;jenkins-hbase4:43103] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 16:10:57,041 DEBUG [RS:2;jenkins-hbase4:45149] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 16:10:57,041 DEBUG [RS:0;jenkins-hbase4:43103] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 16:10:57,041 DEBUG [RS:2;jenkins-hbase4:45149] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 16:10:57,041 DEBUG [RS:0;jenkins-hbase4:43103] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 16:10:57,041 DEBUG [RS:2;jenkins-hbase4:45149] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 16:10:57,041 DEBUG [RS:0;jenkins-hbase4:43103] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 16:10:57,041 DEBUG [RS:2;jenkins-hbase4:45149] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-15 16:10:57,041 DEBUG [RS:0;jenkins-hbase4:43103] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-15 16:10:57,042 DEBUG [RS:2;jenkins-hbase4:45149] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 16:10:57,041 DEBUG [RS:1;jenkins-hbase4:35773] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 16:10:57,042 DEBUG [RS:2;jenkins-hbase4:45149] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 16:10:57,042 DEBUG [RS:0;jenkins-hbase4:43103] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 16:10:57,042 DEBUG [RS:1;jenkins-hbase4:35773] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 16:10:57,042 DEBUG [RS:0;jenkins-hbase4:43103] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 16:10:57,042 DEBUG [RS:1;jenkins-hbase4:35773] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 16:10:57,042 DEBUG [RS:0;jenkins-hbase4:43103] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 16:10:57,042 DEBUG [RS:1;jenkins-hbase4:35773] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 16:10:57,042 DEBUG [RS:0;jenkins-hbase4:43103] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 16:10:57,042 DEBUG [RS:1;jenkins-hbase4:35773] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-15 16:10:57,042 DEBUG [RS:2;jenkins-hbase4:45149] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 16:10:57,043 DEBUG [RS:1;jenkins-hbase4:35773] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 16:10:57,043 DEBUG [RS:2;jenkins-hbase4:45149] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 16:10:57,043 DEBUG [RS:1;jenkins-hbase4:35773] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 16:10:57,043 DEBUG [RS:1;jenkins-hbase4:35773] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 16:10:57,044 DEBUG [RS:1;jenkins-hbase4:35773] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 16:10:57,057 INFO [RS:0;jenkins-hbase4:43103] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-15 16:10:57,058 INFO [RS:0;jenkins-hbase4:43103] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-15 16:10:57,058 INFO [RS:0;jenkins-hbase4:43103] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-15 16:10:57,059 INFO [RS:1;jenkins-hbase4:35773] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-15 16:10:57,059 INFO [RS:1;jenkins-hbase4:35773] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-15 16:10:57,059 INFO [RS:1;jenkins-hbase4:35773] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-15 16:10:57,064 INFO [RS:2;jenkins-hbase4:45149] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-15 16:10:57,065 INFO [RS:2;jenkins-hbase4:45149] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-15 16:10:57,065 INFO [RS:2;jenkins-hbase4:45149] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-15 16:10:57,106 INFO [RS:0;jenkins-hbase4:43103] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-15 16:10:57,109 INFO [RS:0;jenkins-hbase4:43103] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43103,1689437454905-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-15 16:10:57,118 INFO [RS:1;jenkins-hbase4:35773] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-15 16:10:57,128 INFO [RS:1;jenkins-hbase4:35773] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35773,1689437454990-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-15 16:10:57,133 INFO [RS:2;jenkins-hbase4:45149] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-15 16:10:57,133 INFO [RS:2;jenkins-hbase4:45149] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45149,1689437455062-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-15 16:10:57,164 DEBUG [jenkins-hbase4:37255] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-15 16:10:57,170 DEBUG [jenkins-hbase4:37255] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-15 16:10:57,170 INFO [RS:0;jenkins-hbase4:43103] regionserver.Replication(203): jenkins-hbase4.apache.org,43103,1689437454905 started 2023-07-15 16:10:57,170 INFO [RS:0;jenkins-hbase4:43103] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,43103,1689437454905, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:43103, sessionid=0x10169c03b9e0001 2023-07-15 16:10:57,178 INFO [RS:1;jenkins-hbase4:35773] regionserver.Replication(203): jenkins-hbase4.apache.org,35773,1689437454990 started 2023-07-15 16:10:57,178 DEBUG [RS:0;jenkins-hbase4:43103] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-15 16:10:57,179 DEBUG [RS:0;jenkins-hbase4:43103] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:10:57,179 DEBUG [RS:0;jenkins-hbase4:43103] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43103,1689437454905' 2023-07-15 16:10:57,179 DEBUG [RS:0;jenkins-hbase4:43103] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-15 16:10:57,179 INFO [RS:1;jenkins-hbase4:35773] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,35773,1689437454990, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:35773, sessionid=0x10169c03b9e0002 2023-07-15 16:10:57,180 DEBUG [RS:0;jenkins-hbase4:43103] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-15 16:10:57,180 DEBUG [RS:1;jenkins-hbase4:35773] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-15 16:10:57,180 DEBUG [RS:1;jenkins-hbase4:35773] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:10:57,181 INFO [RS:2;jenkins-hbase4:45149] regionserver.Replication(203): jenkins-hbase4.apache.org,45149,1689437455062 started 2023-07-15 16:10:57,181 DEBUG [RS:1;jenkins-hbase4:35773] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35773,1689437454990' 2023-07-15 16:10:57,182 DEBUG [RS:1;jenkins-hbase4:35773] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-15 16:10:57,182 INFO [RS:2;jenkins-hbase4:45149] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,45149,1689437455062, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:45149, sessionid=0x10169c03b9e0003 2023-07-15 16:10:57,182 DEBUG [jenkins-hbase4:37255] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-15 16:10:57,182 DEBUG [RS:2;jenkins-hbase4:45149] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-15 16:10:57,182 DEBUG [RS:0;jenkins-hbase4:43103] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-15 16:10:57,182 DEBUG [RS:2;jenkins-hbase4:45149] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:10:57,183 DEBUG [RS:1;jenkins-hbase4:35773] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-15 16:10:57,182 DEBUG [jenkins-hbase4:37255] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-15 16:10:57,183 DEBUG [jenkins-hbase4:37255] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-15 16:10:57,183 DEBUG [jenkins-hbase4:37255] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-15 16:10:57,183 DEBUG [RS:2;jenkins-hbase4:45149] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45149,1689437455062' 2023-07-15 16:10:57,182 DEBUG [RS:0;jenkins-hbase4:43103] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-15 16:10:57,185 DEBUG [RS:0;jenkins-hbase4:43103] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:10:57,185 DEBUG [RS:1;jenkins-hbase4:35773] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-15 16:10:57,185 DEBUG [RS:2;jenkins-hbase4:45149] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-15 16:10:57,185 DEBUG [RS:0;jenkins-hbase4:43103] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43103,1689437454905' 2023-07-15 16:10:57,186 DEBUG [RS:0;jenkins-hbase4:43103] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:10:57,186 DEBUG [RS:1;jenkins-hbase4:35773] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-15 16:10:57,186 DEBUG [RS:1;jenkins-hbase4:35773] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:10:57,186 DEBUG [RS:1;jenkins-hbase4:35773] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35773,1689437454990' 2023-07-15 16:10:57,186 DEBUG [RS:1;jenkins-hbase4:35773] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:10:57,187 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,43103,1689437454905, state=OPENING 2023-07-15 16:10:57,187 DEBUG [RS:0;jenkins-hbase4:43103] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:10:57,187 DEBUG [RS:1;jenkins-hbase4:35773] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:10:57,191 DEBUG [RS:0;jenkins-hbase4:43103] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-15 16:10:57,191 INFO [RS:0;jenkins-hbase4:43103] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-15 16:10:57,191 INFO [RS:0;jenkins-hbase4:43103] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-15 16:10:57,191 DEBUG [RS:1;jenkins-hbase4:35773] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-15 16:10:57,191 INFO [RS:1;jenkins-hbase4:35773] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-15 16:10:57,192 INFO [RS:1;jenkins-hbase4:35773] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-15 16:10:57,193 DEBUG [RS:2;jenkins-hbase4:45149] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-15 16:10:57,193 DEBUG [RS:2;jenkins-hbase4:45149] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-15 16:10:57,194 DEBUG [RS:2;jenkins-hbase4:45149] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-15 16:10:57,194 DEBUG [RS:2;jenkins-hbase4:45149] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:10:57,194 DEBUG [RS:2;jenkins-hbase4:45149] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45149,1689437455062' 2023-07-15 16:10:57,194 DEBUG [RS:2;jenkins-hbase4:45149] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:10:57,194 DEBUG [RS:2;jenkins-hbase4:45149] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:10:57,195 DEBUG [RS:2;jenkins-hbase4:45149] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-15 16:10:57,195 INFO [RS:2;jenkins-hbase4:45149] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-15 16:10:57,195 INFO [RS:2;jenkins-hbase4:45149] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-15 16:10:57,198 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-15 16:10:57,200 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 16:10:57,201 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-15 16:10:57,205 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,43103,1689437454905}] 2023-07-15 16:10:57,305 INFO [RS:1;jenkins-hbase4:35773] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35773%2C1689437454990, suffix=, logDir=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/WALs/jenkins-hbase4.apache.org,35773,1689437454990, archiveDir=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/oldWALs, maxLogs=32 2023-07-15 16:10:57,305 INFO [RS:0;jenkins-hbase4:43103] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43103%2C1689437454905, suffix=, logDir=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/WALs/jenkins-hbase4.apache.org,43103,1689437454905, archiveDir=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/oldWALs, maxLogs=32 2023-07-15 16:10:57,306 INFO [RS:2;jenkins-hbase4:45149] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45149%2C1689437455062, suffix=, logDir=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/WALs/jenkins-hbase4.apache.org,45149,1689437455062, archiveDir=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/oldWALs, maxLogs=32 2023-07-15 16:10:57,336 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34473,DS-51f6c124-b0bf-4f3a-873d-f10f54d0b558,DISK] 2023-07-15 16:10:57,337 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33583,DS-a9295281-d0c9-4e01-8acb-71c0417d0769,DISK] 2023-07-15 16:10:57,337 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44881,DS-a8e9ee18-efc4-4437-92ee-4662c4af3981,DISK] 2023-07-15 16:10:57,355 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33583,DS-a9295281-d0c9-4e01-8acb-71c0417d0769,DISK] 2023-07-15 16:10:57,356 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44881,DS-a8e9ee18-efc4-4437-92ee-4662c4af3981,DISK] 2023-07-15 16:10:57,356 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34473,DS-51f6c124-b0bf-4f3a-873d-f10f54d0b558,DISK] 2023-07-15 16:10:57,357 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33583,DS-a9295281-d0c9-4e01-8acb-71c0417d0769,DISK] 2023-07-15 16:10:57,358 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44881,DS-a8e9ee18-efc4-4437-92ee-4662c4af3981,DISK] 2023-07-15 16:10:57,358 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34473,DS-51f6c124-b0bf-4f3a-873d-f10f54d0b558,DISK] 2023-07-15 16:10:57,359 INFO [RS:0;jenkins-hbase4:43103] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/WALs/jenkins-hbase4.apache.org,43103,1689437454905/jenkins-hbase4.apache.org%2C43103%2C1689437454905.1689437457311 2023-07-15 16:10:57,360 DEBUG [RS:0;jenkins-hbase4:43103] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34473,DS-51f6c124-b0bf-4f3a-873d-f10f54d0b558,DISK], DatanodeInfoWithStorage[127.0.0.1:44881,DS-a8e9ee18-efc4-4437-92ee-4662c4af3981,DISK], DatanodeInfoWithStorage[127.0.0.1:33583,DS-a9295281-d0c9-4e01-8acb-71c0417d0769,DISK]] 2023-07-15 16:10:57,369 INFO [RS:1;jenkins-hbase4:35773] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/WALs/jenkins-hbase4.apache.org,35773,1689437454990/jenkins-hbase4.apache.org%2C35773%2C1689437454990.1689437457311 2023-07-15 16:10:57,369 INFO [RS:2;jenkins-hbase4:45149] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/WALs/jenkins-hbase4.apache.org,45149,1689437455062/jenkins-hbase4.apache.org%2C45149%2C1689437455062.1689437457313 2023-07-15 16:10:57,370 DEBUG [RS:1;jenkins-hbase4:35773] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34473,DS-51f6c124-b0bf-4f3a-873d-f10f54d0b558,DISK], DatanodeInfoWithStorage[127.0.0.1:44881,DS-a8e9ee18-efc4-4437-92ee-4662c4af3981,DISK], DatanodeInfoWithStorage[127.0.0.1:33583,DS-a9295281-d0c9-4e01-8acb-71c0417d0769,DISK]] 2023-07-15 16:10:57,371 DEBUG [RS:2;jenkins-hbase4:45149] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44881,DS-a8e9ee18-efc4-4437-92ee-4662c4af3981,DISK], DatanodeInfoWithStorage[127.0.0.1:34473,DS-51f6c124-b0bf-4f3a-873d-f10f54d0b558,DISK], DatanodeInfoWithStorage[127.0.0.1:33583,DS-a9295281-d0c9-4e01-8acb-71c0417d0769,DISK]] 2023-07-15 16:10:57,395 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:10:57,398 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-15 16:10:57,400 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59636, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-15 16:10:57,414 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-15 16:10:57,415 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-15 16:10:57,418 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43103%2C1689437454905.meta, suffix=.meta, logDir=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/WALs/jenkins-hbase4.apache.org,43103,1689437454905, archiveDir=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/oldWALs, maxLogs=32 2023-07-15 16:10:57,455 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34473,DS-51f6c124-b0bf-4f3a-873d-f10f54d0b558,DISK] 2023-07-15 16:10:57,463 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33583,DS-a9295281-d0c9-4e01-8acb-71c0417d0769,DISK] 2023-07-15 16:10:57,467 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44881,DS-a8e9ee18-efc4-4437-92ee-4662c4af3981,DISK] 2023-07-15 16:10:57,478 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/WALs/jenkins-hbase4.apache.org,43103,1689437454905/jenkins-hbase4.apache.org%2C43103%2C1689437454905.meta.1689437457420.meta 2023-07-15 16:10:57,479 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34473,DS-51f6c124-b0bf-4f3a-873d-f10f54d0b558,DISK], DatanodeInfoWithStorage[127.0.0.1:33583,DS-a9295281-d0c9-4e01-8acb-71c0417d0769,DISK], DatanodeInfoWithStorage[127.0.0.1:44881,DS-a8e9ee18-efc4-4437-92ee-4662c4af3981,DISK]] 2023-07-15 16:10:57,479 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-15 16:10:57,480 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-15 16:10:57,482 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 16:10:57,483 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-15 16:10:57,486 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-15 16:10:57,491 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-15 16:10:57,510 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-15 16:10:57,510 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 16:10:57,510 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-15 16:10:57,510 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-15 16:10:57,527 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-15 16:10:57,535 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/hbase/meta/1588230740/info 2023-07-15 16:10:57,536 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/hbase/meta/1588230740/info 2023-07-15 16:10:57,536 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-15 16:10:57,538 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 16:10:57,538 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-15 16:10:57,541 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/hbase/meta/1588230740/rep_barrier 2023-07-15 16:10:57,541 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/hbase/meta/1588230740/rep_barrier 2023-07-15 16:10:57,541 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-15 16:10:57,543 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 16:10:57,543 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-15 16:10:57,545 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/hbase/meta/1588230740/table 2023-07-15 16:10:57,545 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/hbase/meta/1588230740/table 2023-07-15 16:10:57,546 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-15 16:10:57,547 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 16:10:57,550 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/hbase/meta/1588230740 2023-07-15 16:10:57,557 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/hbase/meta/1588230740 2023-07-15 16:10:57,569 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-15 16:10:57,571 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-15 16:10:57,573 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65183287, jitterRate=-0.02869333326816559}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-15 16:10:57,576 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-15 16:10:57,597 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689437457388 2023-07-15 16:10:57,631 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-15 16:10:57,631 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,43103,1689437454905, state=OPEN 2023-07-15 16:10:57,632 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-15 16:10:57,635 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-15 16:10:57,636 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-15 16:10:57,641 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-15 16:10:57,641 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,43103,1689437454905 in 430 msec 2023-07-15 16:10:57,647 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-15 16:10:57,647 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 654 msec 2023-07-15 16:10:57,655 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.0430 sec 2023-07-15 16:10:57,655 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689437457655, completionTime=-1 2023-07-15 16:10:57,655 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-15 16:10:57,655 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-15 16:10:57,742 DEBUG [hconnection-0x606da78-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 16:10:57,746 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59646, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 16:10:57,776 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-15 16:10:57,777 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689437517777 2023-07-15 16:10:57,777 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689437577777 2023-07-15 16:10:57,777 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 121 msec 2023-07-15 16:10:57,812 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37255,1689437453412-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-15 16:10:57,812 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37255,1689437453412-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-15 16:10:57,812 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37255,1689437453412-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-15 16:10:57,816 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:37255, period=300000, unit=MILLISECONDS is enabled. 2023-07-15 16:10:57,817 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-15 16:10:57,833 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-15 16:10:57,846 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-15 16:10:57,847 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-15 16:10:57,858 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-15 16:10:57,862 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-15 16:10:57,867 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-15 16:10:57,911 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/hbase/namespace/61753328474b6352129c56be3b30fd40 2023-07-15 16:10:57,916 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/hbase/namespace/61753328474b6352129c56be3b30fd40 empty. 2023-07-15 16:10:57,917 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/hbase/namespace/61753328474b6352129c56be3b30fd40 2023-07-15 16:10:57,917 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-15 16:10:58,014 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-15 16:10:58,026 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 61753328474b6352129c56be3b30fd40, NAME => 'hbase:namespace,,1689437457847.61753328474b6352129c56be3b30fd40.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp 2023-07-15 16:10:58,114 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689437457847.61753328474b6352129c56be3b30fd40.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 16:10:58,115 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 61753328474b6352129c56be3b30fd40, disabling compactions & flushes 2023-07-15 16:10:58,115 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689437457847.61753328474b6352129c56be3b30fd40. 2023-07-15 16:10:58,115 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689437457847.61753328474b6352129c56be3b30fd40. 2023-07-15 16:10:58,115 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689437457847.61753328474b6352129c56be3b30fd40. after waiting 0 ms 2023-07-15 16:10:58,115 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689437457847.61753328474b6352129c56be3b30fd40. 2023-07-15 16:10:58,115 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689437457847.61753328474b6352129c56be3b30fd40. 2023-07-15 16:10:58,115 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 61753328474b6352129c56be3b30fd40: 2023-07-15 16:10:58,121 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-15 16:10:58,137 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689437457847.61753328474b6352129c56be3b30fd40.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689437458125"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689437458125"}]},"ts":"1689437458125"} 2023-07-15 16:10:58,173 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-15 16:10:58,176 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-15 16:10:58,182 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689437458177"}]},"ts":"1689437458177"} 2023-07-15 16:10:58,187 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-15 16:10:58,197 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-15 16:10:58,198 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-15 16:10:58,198 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-15 16:10:58,198 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-15 16:10:58,198 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-15 16:10:58,201 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=61753328474b6352129c56be3b30fd40, ASSIGN}] 2023-07-15 16:10:58,206 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=61753328474b6352129c56be3b30fd40, ASSIGN 2023-07-15 16:10:58,209 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=61753328474b6352129c56be3b30fd40, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43103,1689437454905; forceNewPlan=false, retain=false 2023-07-15 16:10:58,361 INFO [jenkins-hbase4:37255] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-15 16:10:58,363 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=61753328474b6352129c56be3b30fd40, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:10:58,364 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689437457847.61753328474b6352129c56be3b30fd40.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689437458363"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689437458363"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689437458363"}]},"ts":"1689437458363"} 2023-07-15 16:10:58,370 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 61753328474b6352129c56be3b30fd40, server=jenkins-hbase4.apache.org,43103,1689437454905}] 2023-07-15 16:10:58,531 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689437457847.61753328474b6352129c56be3b30fd40. 2023-07-15 16:10:58,532 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 61753328474b6352129c56be3b30fd40, NAME => 'hbase:namespace,,1689437457847.61753328474b6352129c56be3b30fd40.', STARTKEY => '', ENDKEY => ''} 2023-07-15 16:10:58,532 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1689437457847.61753328474b6352129c56be3b30fd40. service=AccessControlService 2023-07-15 16:10:58,533 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 16:10:58,533 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 61753328474b6352129c56be3b30fd40 2023-07-15 16:10:58,533 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689437457847.61753328474b6352129c56be3b30fd40.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 16:10:58,534 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 61753328474b6352129c56be3b30fd40 2023-07-15 16:10:58,534 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 61753328474b6352129c56be3b30fd40 2023-07-15 16:10:58,536 INFO [StoreOpener-61753328474b6352129c56be3b30fd40-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 61753328474b6352129c56be3b30fd40 2023-07-15 16:10:58,539 DEBUG [StoreOpener-61753328474b6352129c56be3b30fd40-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/hbase/namespace/61753328474b6352129c56be3b30fd40/info 2023-07-15 16:10:58,539 DEBUG [StoreOpener-61753328474b6352129c56be3b30fd40-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/hbase/namespace/61753328474b6352129c56be3b30fd40/info 2023-07-15 16:10:58,539 INFO [StoreOpener-61753328474b6352129c56be3b30fd40-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 61753328474b6352129c56be3b30fd40 columnFamilyName info 2023-07-15 16:10:58,540 INFO [StoreOpener-61753328474b6352129c56be3b30fd40-1] regionserver.HStore(310): Store=61753328474b6352129c56be3b30fd40/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 16:10:58,542 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/hbase/namespace/61753328474b6352129c56be3b30fd40 2023-07-15 16:10:58,543 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/hbase/namespace/61753328474b6352129c56be3b30fd40 2023-07-15 16:10:58,547 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 61753328474b6352129c56be3b30fd40 2023-07-15 16:10:58,551 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/hbase/namespace/61753328474b6352129c56be3b30fd40/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 16:10:58,552 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 61753328474b6352129c56be3b30fd40; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63749126, jitterRate=-0.05006399750709534}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 16:10:58,552 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 61753328474b6352129c56be3b30fd40: 2023-07-15 16:10:58,556 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689437457847.61753328474b6352129c56be3b30fd40., pid=6, masterSystemTime=1689437458524 2023-07-15 16:10:58,560 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689437457847.61753328474b6352129c56be3b30fd40. 2023-07-15 16:10:58,560 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689437457847.61753328474b6352129c56be3b30fd40. 2023-07-15 16:10:58,562 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=61753328474b6352129c56be3b30fd40, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:10:58,563 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689437457847.61753328474b6352129c56be3b30fd40.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689437458561"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689437458561"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689437458561"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689437458561"}]},"ts":"1689437458561"} 2023-07-15 16:10:58,570 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-15 16:10:58,571 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 61753328474b6352129c56be3b30fd40, server=jenkins-hbase4.apache.org,43103,1689437454905 in 196 msec 2023-07-15 16:10:58,574 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-15 16:10:58,575 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=61753328474b6352129c56be3b30fd40, ASSIGN in 370 msec 2023-07-15 16:10:58,577 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-15 16:10:58,577 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689437458577"}]},"ts":"1689437458577"} 2023-07-15 16:10:58,579 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-15 16:10:58,584 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-15 16:10:58,587 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 736 msec 2023-07-15 16:10:58,665 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-15 16:10:58,667 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-15 16:10:58,667 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 16:10:58,704 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-15 16:10:58,722 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-15 16:10:58,728 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 32 msec 2023-07-15 16:10:58,737 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-15 16:10:58,751 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-15 16:10:58,757 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 19 msec 2023-07-15 16:10:58,763 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-15 16:10:58,767 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-15 16:10:58,767 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.566sec 2023-07-15 16:10:58,770 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-15 16:10:58,772 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-15 16:10:58,772 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-15 16:10:58,774 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37255,1689437453412-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-15 16:10:58,774 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37255,1689437453412-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-15 16:10:58,797 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-15 16:10:58,799 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-15 16:10:58,802 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-15 16:10:58,806 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-15 16:10:58,807 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-07-15 16:10:58,809 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/hbase/acl/8b5d5a65401d803b4727a0c1e162963b 2023-07-15 16:10:58,810 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/hbase/acl/8b5d5a65401d803b4727a0c1e162963b empty. 2023-07-15 16:10:58,815 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/hbase/acl/8b5d5a65401d803b4727a0c1e162963b 2023-07-15 16:10:58,815 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-15 16:10:58,816 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-15 16:10:58,845 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-15 16:10:58,847 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => 8b5d5a65401d803b4727a0c1e162963b, NAME => 'hbase:acl,,1689437458792.8b5d5a65401d803b4727a0c1e162963b.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp 2023-07-15 16:10:58,861 DEBUG [Listener at localhost/39933] zookeeper.ReadOnlyZKClient(139): Connect 0x3b044b2a to 127.0.0.1:58438 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 16:10:58,868 DEBUG [Listener at localhost/39933] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@583f0bf, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 16:10:58,869 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689437458792.8b5d5a65401d803b4727a0c1e162963b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 16:10:58,870 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing 8b5d5a65401d803b4727a0c1e162963b, disabling compactions & flushes 2023-07-15 16:10:58,870 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689437458792.8b5d5a65401d803b4727a0c1e162963b. 2023-07-15 16:10:58,870 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689437458792.8b5d5a65401d803b4727a0c1e162963b. 2023-07-15 16:10:58,870 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689437458792.8b5d5a65401d803b4727a0c1e162963b. after waiting 0 ms 2023-07-15 16:10:58,870 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689437458792.8b5d5a65401d803b4727a0c1e162963b. 2023-07-15 16:10:58,870 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1689437458792.8b5d5a65401d803b4727a0c1e162963b. 2023-07-15 16:10:58,870 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for 8b5d5a65401d803b4727a0c1e162963b: 2023-07-15 16:10:58,878 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-15 16:10:58,880 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1689437458792.8b5d5a65401d803b4727a0c1e162963b.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689437458879"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689437458879"}]},"ts":"1689437458879"} 2023-07-15 16:10:58,882 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-15 16:10:58,885 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-15 16:10:58,885 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689437458885"}]},"ts":"1689437458885"} 2023-07-15 16:10:58,888 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-15 16:10:58,889 DEBUG [hconnection-0x5aea2364-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 16:10:58,893 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-15 16:10:58,895 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-15 16:10:58,895 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-15 16:10:58,895 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-15 16:10:58,895 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-15 16:10:58,896 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=8b5d5a65401d803b4727a0c1e162963b, ASSIGN}] 2023-07-15 16:10:58,898 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=8b5d5a65401d803b4727a0c1e162963b, ASSIGN 2023-07-15 16:10:58,900 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=8b5d5a65401d803b4727a0c1e162963b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43103,1689437454905; forceNewPlan=false, retain=false 2023-07-15 16:10:58,905 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59652, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 16:10:58,908 INFO [Listener at localhost/39933] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,37255,1689437453412 2023-07-15 16:10:58,908 INFO [Listener at localhost/39933] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-07-15 16:10:58,908 INFO [Listener at localhost/39933] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1587f29c-5daf-234a-1773-5088522b715e/test.cache.data in system properties and HBase conf 2023-07-15 16:10:58,908 INFO [Listener at localhost/39933] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1587f29c-5daf-234a-1773-5088522b715e/hadoop.tmp.dir in system properties and HBase conf 2023-07-15 16:10:58,908 INFO [Listener at localhost/39933] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1587f29c-5daf-234a-1773-5088522b715e/hadoop.log.dir in system properties and HBase conf 2023-07-15 16:10:58,908 INFO [Listener at localhost/39933] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1587f29c-5daf-234a-1773-5088522b715e/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-15 16:10:58,908 INFO [Listener at localhost/39933] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1587f29c-5daf-234a-1773-5088522b715e/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-15 16:10:58,908 INFO [Listener at localhost/39933] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-15 16:10:58,909 INFO [Listener at localhost/39933] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1587f29c-5daf-234a-1773-5088522b715e/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-15 16:10:58,909 INFO [Listener at localhost/39933] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1587f29c-5daf-234a-1773-5088522b715e/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-15 16:10:58,909 INFO [Listener at localhost/39933] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1587f29c-5daf-234a-1773-5088522b715e/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-15 16:10:58,909 INFO [Listener at localhost/39933] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1587f29c-5daf-234a-1773-5088522b715e/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-15 16:10:58,909 INFO [Listener at localhost/39933] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1587f29c-5daf-234a-1773-5088522b715e/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-15 16:10:58,909 INFO [Listener at localhost/39933] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1587f29c-5daf-234a-1773-5088522b715e/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-15 16:10:58,909 INFO [Listener at localhost/39933] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1587f29c-5daf-234a-1773-5088522b715e/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-15 16:10:58,909 INFO [Listener at localhost/39933] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1587f29c-5daf-234a-1773-5088522b715e/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-15 16:10:58,910 INFO [Listener at localhost/39933] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1587f29c-5daf-234a-1773-5088522b715e/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-15 16:10:58,910 INFO [Listener at localhost/39933] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1587f29c-5daf-234a-1773-5088522b715e/nfs.dump.dir in system properties and HBase conf 2023-07-15 16:10:58,910 INFO [Listener at localhost/39933] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1587f29c-5daf-234a-1773-5088522b715e/java.io.tmpdir in system properties and HBase conf 2023-07-15 16:10:58,910 INFO [Listener at localhost/39933] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1587f29c-5daf-234a-1773-5088522b715e/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-15 16:10:58,910 INFO [Listener at localhost/39933] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1587f29c-5daf-234a-1773-5088522b715e/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-15 16:10:58,910 INFO [Listener at localhost/39933] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1587f29c-5daf-234a-1773-5088522b715e/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-07-15 16:10:58,920 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-15 16:10:59,051 INFO [jenkins-hbase4:37255] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-15 16:10:59,052 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=8b5d5a65401d803b4727a0c1e162963b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:10:59,052 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1689437458792.8b5d5a65401d803b4727a0c1e162963b.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689437459052"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689437459052"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689437459052"}]},"ts":"1689437459052"} 2023-07-15 16:10:59,056 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 8b5d5a65401d803b4727a0c1e162963b, server=jenkins-hbase4.apache.org,43103,1689437454905}] 2023-07-15 16:10:59,120 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-15 16:10:59,215 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1689437458792.8b5d5a65401d803b4727a0c1e162963b. 2023-07-15 16:10:59,215 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8b5d5a65401d803b4727a0c1e162963b, NAME => 'hbase:acl,,1689437458792.8b5d5a65401d803b4727a0c1e162963b.', STARTKEY => '', ENDKEY => ''} 2023-07-15 16:10:59,216 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1689437458792.8b5d5a65401d803b4727a0c1e162963b. service=AccessControlService 2023-07-15 16:10:59,216 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 16:10:59,216 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl 8b5d5a65401d803b4727a0c1e162963b 2023-07-15 16:10:59,216 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689437458792.8b5d5a65401d803b4727a0c1e162963b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 16:10:59,216 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 8b5d5a65401d803b4727a0c1e162963b 2023-07-15 16:10:59,216 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 8b5d5a65401d803b4727a0c1e162963b 2023-07-15 16:10:59,218 INFO [StoreOpener-8b5d5a65401d803b4727a0c1e162963b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region 8b5d5a65401d803b4727a0c1e162963b 2023-07-15 16:10:59,221 DEBUG [StoreOpener-8b5d5a65401d803b4727a0c1e162963b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/hbase/acl/8b5d5a65401d803b4727a0c1e162963b/l 2023-07-15 16:10:59,221 DEBUG [StoreOpener-8b5d5a65401d803b4727a0c1e162963b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/hbase/acl/8b5d5a65401d803b4727a0c1e162963b/l 2023-07-15 16:10:59,221 INFO [StoreOpener-8b5d5a65401d803b4727a0c1e162963b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8b5d5a65401d803b4727a0c1e162963b columnFamilyName l 2023-07-15 16:10:59,222 INFO [StoreOpener-8b5d5a65401d803b4727a0c1e162963b-1] regionserver.HStore(310): Store=8b5d5a65401d803b4727a0c1e162963b/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 16:10:59,225 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/hbase/acl/8b5d5a65401d803b4727a0c1e162963b 2023-07-15 16:10:59,227 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/hbase/acl/8b5d5a65401d803b4727a0c1e162963b 2023-07-15 16:10:59,232 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 8b5d5a65401d803b4727a0c1e162963b 2023-07-15 16:10:59,236 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/hbase/acl/8b5d5a65401d803b4727a0c1e162963b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 16:10:59,237 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 8b5d5a65401d803b4727a0c1e162963b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68343811, jitterRate=0.01840214431285858}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 16:10:59,238 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 8b5d5a65401d803b4727a0c1e162963b: 2023-07-15 16:10:59,239 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1689437458792.8b5d5a65401d803b4727a0c1e162963b., pid=11, masterSystemTime=1689437459210 2023-07-15 16:10:59,242 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1689437458792.8b5d5a65401d803b4727a0c1e162963b. 2023-07-15 16:10:59,242 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1689437458792.8b5d5a65401d803b4727a0c1e162963b. 2023-07-15 16:10:59,243 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=8b5d5a65401d803b4727a0c1e162963b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:10:59,244 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1689437458792.8b5d5a65401d803b4727a0c1e162963b.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689437459243"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689437459243"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689437459243"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689437459243"}]},"ts":"1689437459243"} 2023-07-15 16:10:59,250 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-15 16:10:59,250 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 8b5d5a65401d803b4727a0c1e162963b, server=jenkins-hbase4.apache.org,43103,1689437454905 in 191 msec 2023-07-15 16:10:59,255 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-15 16:10:59,255 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=8b5d5a65401d803b4727a0c1e162963b, ASSIGN in 354 msec 2023-07-15 16:10:59,257 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-15 16:10:59,257 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689437459257"}]},"ts":"1689437459257"} 2023-07-15 16:10:59,260 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-15 16:10:59,265 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-15 16:10:59,269 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 468 msec 2023-07-15 16:10:59,421 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-15 16:10:59,421 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-07-15 16:10:59,432 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-15 16:11:00,370 WARN [Thread-383] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-15 16:11:00,754 INFO [Thread-383] log.Slf4jLog(67): jetty-6.1.26 2023-07-15 16:11:00,763 INFO [Thread-383] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1587f29c-5daf-234a-1773-5088522b715e/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_44571_jobhistory____.5uewnc/webapp 2023-07-15 16:11:00,950 INFO [Thread-383] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-07-15 16:11:00,950 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-07-15 16:11:00,950 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-15 16:11:00,954 INFO [Thread-383] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-15 16:11:01,055 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-15 16:11:01,424 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-15 16:11:01,801 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-07-15 16:11:01,863 INFO [Thread-383] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:44571 2023-07-15 16:11:03,115 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-15 16:11:03,343 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-15 16:11:03,344 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-15 16:11:03,345 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-15 16:11:03,362 WARN [Listener at jenkins-hbase4.apache.org/44471] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-15 16:11:03,468 WARN [Listener at jenkins-hbase4.apache.org/44471] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-15 16:11:03,468 INFO [Listener at jenkins-hbase4.apache.org/44471] log.Slf4jLog(67): jetty-6.1.26 2023-07-15 16:11:03,503 INFO [Listener at jenkins-hbase4.apache.org/44471] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1587f29c-5daf-234a-1773-5088522b715e/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_46419_cluster____qbljuy/webapp 2023-07-15 16:11:03,595 INFO [Listener at jenkins-hbase4.apache.org/44471] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-07-15 16:11:03,596 INFO [Listener at jenkins-hbase4.apache.org/44471] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-07-15 16:11:03,596 INFO [Listener at jenkins-hbase4.apache.org/44471] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-15 16:11:03,596 INFO [Listener at jenkins-hbase4.apache.org/44471] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-15 16:11:03,609 INFO [Listener at jenkins-hbase4.apache.org/44471] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-15 16:11:03,634 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 16:11:03,635 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-15 16:11:03,636 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 16:11:03,636 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-15 16:11:03,637 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-15 16:11:03,637 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-15 16:11:03,637 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 16:11:03,637 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-15 16:11:03,637 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-15 16:11:03,637 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-15 16:11:03,832 INFO [Listener at jenkins-hbase4.apache.org/44471] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-15 16:11:03,942 INFO [Listener at jenkins-hbase4.apache.org/44471] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-15 16:11:03,949 INFO [Listener at jenkins-hbase4.apache.org/44471] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:46419 2023-07-15 16:11:04,498 WARN [Listener at jenkins-hbase4.apache.org/43253] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-15 16:11:04,531 WARN [Listener at jenkins-hbase4.apache.org/43253] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-15 16:11:04,532 INFO [Listener at jenkins-hbase4.apache.org/43253] log.Slf4jLog(67): jetty-6.1.26 2023-07-15 16:11:04,542 INFO [Listener at jenkins-hbase4.apache.org/43253] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1587f29c-5daf-234a-1773-5088522b715e/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_40807_node____q1hzep/webapp 2023-07-15 16:11:04,605 INFO [Listener at jenkins-hbase4.apache.org/43253] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-15 16:11:04,605 INFO [Listener at jenkins-hbase4.apache.org/43253] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-15 16:11:04,605 INFO [Listener at jenkins-hbase4.apache.org/43253] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-15 16:11:04,605 INFO [Listener at jenkins-hbase4.apache.org/43253] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-15 16:11:04,614 INFO [Listener at jenkins-hbase4.apache.org/43253] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-15 16:11:04,640 INFO [Listener at jenkins-hbase4.apache.org/43253] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-15 16:11:04,724 INFO [Listener at jenkins-hbase4.apache.org/43253] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-15 16:11:04,738 INFO [Listener at jenkins-hbase4.apache.org/43253] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:40807 2023-07-15 16:11:04,967 WARN [Listener at jenkins-hbase4.apache.org/42699] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-15 16:11:04,976 WARN [Listener at jenkins-hbase4.apache.org/42699] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-15 16:11:04,976 INFO [Listener at jenkins-hbase4.apache.org/42699] log.Slf4jLog(67): jetty-6.1.26 2023-07-15 16:11:04,984 INFO [Listener at jenkins-hbase4.apache.org/42699] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1587f29c-5daf-234a-1773-5088522b715e/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_40093_node____.11qo38/webapp 2023-07-15 16:11:05,039 INFO [Listener at jenkins-hbase4.apache.org/42699] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-15 16:11:05,040 INFO [Listener at jenkins-hbase4.apache.org/42699] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-15 16:11:05,040 INFO [Listener at jenkins-hbase4.apache.org/42699] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-15 16:11:05,040 INFO [Listener at jenkins-hbase4.apache.org/42699] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-15 16:11:05,052 INFO [Listener at jenkins-hbase4.apache.org/42699] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-15 16:11:05,074 INFO [Listener at jenkins-hbase4.apache.org/42699] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-15 16:11:05,159 INFO [Listener at jenkins-hbase4.apache.org/42699] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-15 16:11:05,193 INFO [Listener at jenkins-hbase4.apache.org/42699] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:40093 2023-07-15 16:11:05,264 INFO [Listener at jenkins-hbase4.apache.org/42699] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-07-15 16:11:05,266 INFO [Listener at jenkins-hbase4.apache.org/42699] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 16:11:05,348 INFO [Listener at jenkins-hbase4.apache.org/42699] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportWithTargetName Thread=706, OpenFileDescriptor=892, MaxFileDescriptor=60000, SystemLoadAverage=290, ProcessCount=177, AvailableMemoryMB=4934 2023-07-15 16:11:05,348 WARN [Listener at jenkins-hbase4.apache.org/42699] hbase.ResourceChecker(130): Thread=706 is superior to 500 2023-07-15 16:11:05,365 DEBUG [Listener at jenkins-hbase4.apache.org/42699] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-15 16:11:05,374 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40258, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-15 16:11:05,383 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-15 16:11:05,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-07-15 16:11:05,393 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-07-15 16:11:05,395 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-07-15 16:11:05,396 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-15 16:11:05,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-15 16:11:05,401 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testExportWithTargetName/09f9fe0470f39453610cd998c0d5aa1f 2023-07-15 16:11:05,402 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testExportWithTargetName/09f9fe0470f39453610cd998c0d5aa1f empty. 2023-07-15 16:11:05,405 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testExportWithTargetName/1548cc56c4470f14e75dcf232af4c0a2 2023-07-15 16:11:05,405 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testExportWithTargetName/09f9fe0470f39453610cd998c0d5aa1f 2023-07-15 16:11:05,408 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testExportWithTargetName/1548cc56c4470f14e75dcf232af4c0a2 empty. 2023-07-15 16:11:05,409 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testExportWithTargetName/1548cc56c4470f14e75dcf232af4c0a2 2023-07-15 16:11:05,409 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-15 16:11:05,463 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-07-15 16:11:05,467 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => 09f9fe0470f39453610cd998c0d5aa1f, NAME => 'testtb-testExportWithTargetName,,1689437465382.09f9fe0470f39453610cd998c0d5aa1f.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp 2023-07-15 16:11:05,471 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => 1548cc56c4470f14e75dcf232af4c0a2, NAME => 'testtb-testExportWithTargetName,1,1689437465382.1548cc56c4470f14e75dcf232af4c0a2.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp 2023-07-15 16:11:05,501 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-15 16:11:05,546 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689437465382.1548cc56c4470f14e75dcf232af4c0a2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 16:11:05,547 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing 1548cc56c4470f14e75dcf232af4c0a2, disabling compactions & flushes 2023-07-15 16:11:05,547 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689437465382.1548cc56c4470f14e75dcf232af4c0a2. 2023-07-15 16:11:05,547 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689437465382.1548cc56c4470f14e75dcf232af4c0a2. 2023-07-15 16:11:05,547 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689437465382.1548cc56c4470f14e75dcf232af4c0a2. after waiting 0 ms 2023-07-15 16:11:05,548 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689437465382.1548cc56c4470f14e75dcf232af4c0a2. 2023-07-15 16:11:05,548 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689437465382.1548cc56c4470f14e75dcf232af4c0a2. 2023-07-15 16:11:05,548 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for 1548cc56c4470f14e75dcf232af4c0a2: 2023-07-15 16:11:05,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-15 16:11:05,938 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689437465382.09f9fe0470f39453610cd998c0d5aa1f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 16:11:05,939 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing 09f9fe0470f39453610cd998c0d5aa1f, disabling compactions & flushes 2023-07-15 16:11:05,939 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689437465382.09f9fe0470f39453610cd998c0d5aa1f. 2023-07-15 16:11:05,939 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689437465382.09f9fe0470f39453610cd998c0d5aa1f. 2023-07-15 16:11:05,939 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689437465382.09f9fe0470f39453610cd998c0d5aa1f. after waiting 0 ms 2023-07-15 16:11:05,939 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689437465382.09f9fe0470f39453610cd998c0d5aa1f. 2023-07-15 16:11:05,939 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689437465382.09f9fe0470f39453610cd998c0d5aa1f. 2023-07-15 16:11:05,939 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for 09f9fe0470f39453610cd998c0d5aa1f: 2023-07-15 16:11:05,943 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-07-15 16:11:05,945 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689437465382.1548cc56c4470f14e75dcf232af4c0a2.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689437465944"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689437465944"}]},"ts":"1689437465944"} 2023-07-15 16:11:05,945 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689437465382.09f9fe0470f39453610cd998c0d5aa1f.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689437465944"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689437465944"}]},"ts":"1689437465944"} 2023-07-15 16:11:05,996 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-15 16:11:05,997 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-15 16:11:05,997 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689437465997"}]},"ts":"1689437465997"} 2023-07-15 16:11:05,999 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-07-15 16:11:06,006 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-15 16:11:06,008 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-15 16:11:06,008 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-15 16:11:06,008 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-15 16:11:06,008 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-15 16:11:06,009 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=09f9fe0470f39453610cd998c0d5aa1f, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=1548cc56c4470f14e75dcf232af4c0a2, ASSIGN}] 2023-07-15 16:11:06,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-15 16:11:06,012 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=09f9fe0470f39453610cd998c0d5aa1f, ASSIGN 2023-07-15 16:11:06,012 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=1548cc56c4470f14e75dcf232af4c0a2, ASSIGN 2023-07-15 16:11:06,014 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=1548cc56c4470f14e75dcf232af4c0a2, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43103,1689437454905; forceNewPlan=false, retain=false 2023-07-15 16:11:06,014 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=09f9fe0470f39453610cd998c0d5aa1f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45149,1689437455062; forceNewPlan=false, retain=false 2023-07-15 16:11:06,164 INFO [jenkins-hbase4:37255] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-15 16:11:06,167 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=1548cc56c4470f14e75dcf232af4c0a2, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:06,167 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=09f9fe0470f39453610cd998c0d5aa1f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:11:06,167 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689437465382.1548cc56c4470f14e75dcf232af4c0a2.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689437466167"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689437466167"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689437466167"}]},"ts":"1689437466167"} 2023-07-15 16:11:06,167 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689437465382.09f9fe0470f39453610cd998c0d5aa1f.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689437466167"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689437466167"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689437466167"}]},"ts":"1689437466167"} 2023-07-15 16:11:06,170 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE; OpenRegionProcedure 1548cc56c4470f14e75dcf232af4c0a2, server=jenkins-hbase4.apache.org,43103,1689437454905}] 2023-07-15 16:11:06,172 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=13, state=RUNNABLE; OpenRegionProcedure 09f9fe0470f39453610cd998c0d5aa1f, server=jenkins-hbase4.apache.org,45149,1689437455062}] 2023-07-15 16:11:06,327 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:11:06,327 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-15 16:11:06,331 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56156, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-15 16:11:06,335 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1689437465382.1548cc56c4470f14e75dcf232af4c0a2. 2023-07-15 16:11:06,335 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1548cc56c4470f14e75dcf232af4c0a2, NAME => 'testtb-testExportWithTargetName,1,1689437465382.1548cc56c4470f14e75dcf232af4c0a2.', STARTKEY => '1', ENDKEY => ''} 2023-07-15 16:11:06,335 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1689437465382.1548cc56c4470f14e75dcf232af4c0a2. service=AccessControlService 2023-07-15 16:11:06,335 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 16:11:06,336 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 1548cc56c4470f14e75dcf232af4c0a2 2023-07-15 16:11:06,336 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689437465382.1548cc56c4470f14e75dcf232af4c0a2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 16:11:06,336 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1548cc56c4470f14e75dcf232af4c0a2 2023-07-15 16:11:06,336 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1689437465382.09f9fe0470f39453610cd998c0d5aa1f. 2023-07-15 16:11:06,336 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1548cc56c4470f14e75dcf232af4c0a2 2023-07-15 16:11:06,336 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 09f9fe0470f39453610cd998c0d5aa1f, NAME => 'testtb-testExportWithTargetName,,1689437465382.09f9fe0470f39453610cd998c0d5aa1f.', STARTKEY => '', ENDKEY => '1'} 2023-07-15 16:11:06,336 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1689437465382.09f9fe0470f39453610cd998c0d5aa1f. service=AccessControlService 2023-07-15 16:11:06,337 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 16:11:06,337 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 09f9fe0470f39453610cd998c0d5aa1f 2023-07-15 16:11:06,337 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689437465382.09f9fe0470f39453610cd998c0d5aa1f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 16:11:06,337 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 09f9fe0470f39453610cd998c0d5aa1f 2023-07-15 16:11:06,337 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 09f9fe0470f39453610cd998c0d5aa1f 2023-07-15 16:11:06,338 INFO [StoreOpener-1548cc56c4470f14e75dcf232af4c0a2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 1548cc56c4470f14e75dcf232af4c0a2 2023-07-15 16:11:06,339 INFO [StoreOpener-09f9fe0470f39453610cd998c0d5aa1f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 09f9fe0470f39453610cd998c0d5aa1f 2023-07-15 16:11:06,340 DEBUG [StoreOpener-1548cc56c4470f14e75dcf232af4c0a2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportWithTargetName/1548cc56c4470f14e75dcf232af4c0a2/cf 2023-07-15 16:11:06,340 DEBUG [StoreOpener-1548cc56c4470f14e75dcf232af4c0a2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportWithTargetName/1548cc56c4470f14e75dcf232af4c0a2/cf 2023-07-15 16:11:06,340 INFO [StoreOpener-1548cc56c4470f14e75dcf232af4c0a2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1548cc56c4470f14e75dcf232af4c0a2 columnFamilyName cf 2023-07-15 16:11:06,341 DEBUG [StoreOpener-09f9fe0470f39453610cd998c0d5aa1f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportWithTargetName/09f9fe0470f39453610cd998c0d5aa1f/cf 2023-07-15 16:11:06,341 DEBUG [StoreOpener-09f9fe0470f39453610cd998c0d5aa1f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportWithTargetName/09f9fe0470f39453610cd998c0d5aa1f/cf 2023-07-15 16:11:06,341 INFO [StoreOpener-1548cc56c4470f14e75dcf232af4c0a2-1] regionserver.HStore(310): Store=1548cc56c4470f14e75dcf232af4c0a2/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 16:11:06,342 INFO [StoreOpener-09f9fe0470f39453610cd998c0d5aa1f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 09f9fe0470f39453610cd998c0d5aa1f columnFamilyName cf 2023-07-15 16:11:06,343 INFO [StoreOpener-09f9fe0470f39453610cd998c0d5aa1f-1] regionserver.HStore(310): Store=09f9fe0470f39453610cd998c0d5aa1f/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 16:11:06,343 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportWithTargetName/1548cc56c4470f14e75dcf232af4c0a2 2023-07-15 16:11:06,344 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportWithTargetName/1548cc56c4470f14e75dcf232af4c0a2 2023-07-15 16:11:06,345 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportWithTargetName/09f9fe0470f39453610cd998c0d5aa1f 2023-07-15 16:11:06,345 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportWithTargetName/09f9fe0470f39453610cd998c0d5aa1f 2023-07-15 16:11:06,348 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1548cc56c4470f14e75dcf232af4c0a2 2023-07-15 16:11:06,349 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 09f9fe0470f39453610cd998c0d5aa1f 2023-07-15 16:11:06,354 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportWithTargetName/1548cc56c4470f14e75dcf232af4c0a2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 16:11:06,355 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportWithTargetName/09f9fe0470f39453610cd998c0d5aa1f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 16:11:06,355 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1548cc56c4470f14e75dcf232af4c0a2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71174239, jitterRate=0.060578808188438416}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 16:11:06,355 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1548cc56c4470f14e75dcf232af4c0a2: 2023-07-15 16:11:06,356 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 09f9fe0470f39453610cd998c0d5aa1f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61208347, jitterRate=-0.08792455494403839}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 16:11:06,356 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 09f9fe0470f39453610cd998c0d5aa1f: 2023-07-15 16:11:06,357 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1689437465382.1548cc56c4470f14e75dcf232af4c0a2., pid=15, masterSystemTime=1689437466326 2023-07-15 16:11:06,357 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1689437465382.09f9fe0470f39453610cd998c0d5aa1f., pid=16, masterSystemTime=1689437466327 2023-07-15 16:11:06,361 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1689437465382.1548cc56c4470f14e75dcf232af4c0a2. 2023-07-15 16:11:06,361 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1689437465382.1548cc56c4470f14e75dcf232af4c0a2. 2023-07-15 16:11:06,362 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=1548cc56c4470f14e75dcf232af4c0a2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:06,362 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1689437465382.09f9fe0470f39453610cd998c0d5aa1f. 2023-07-15 16:11:06,363 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1689437465382.09f9fe0470f39453610cd998c0d5aa1f. 2023-07-15 16:11:06,363 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1689437465382.1548cc56c4470f14e75dcf232af4c0a2.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689437466362"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689437466362"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689437466362"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689437466362"}]},"ts":"1689437466362"} 2023-07-15 16:11:06,364 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=09f9fe0470f39453610cd998c0d5aa1f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:11:06,364 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1689437465382.09f9fe0470f39453610cd998c0d5aa1f.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689437466364"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689437466364"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689437466364"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689437466364"}]},"ts":"1689437466364"} 2023-07-15 16:11:06,371 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=14 2023-07-15 16:11:06,375 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=14, state=SUCCESS; OpenRegionProcedure 1548cc56c4470f14e75dcf232af4c0a2, server=jenkins-hbase4.apache.org,43103,1689437454905 in 198 msec 2023-07-15 16:11:06,379 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=13 2023-07-15 16:11:06,379 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=1548cc56c4470f14e75dcf232af4c0a2, ASSIGN in 366 msec 2023-07-15 16:11:06,381 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=13, state=SUCCESS; OpenRegionProcedure 09f9fe0470f39453610cd998c0d5aa1f, server=jenkins-hbase4.apache.org,45149,1689437455062 in 199 msec 2023-07-15 16:11:06,384 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=13, resume processing ppid=12 2023-07-15 16:11:06,384 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=09f9fe0470f39453610cd998c0d5aa1f, ASSIGN in 370 msec 2023-07-15 16:11:06,385 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-15 16:11:06,386 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689437466385"}]},"ts":"1689437466385"} 2023-07-15 16:11:06,388 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-07-15 16:11:06,391 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-07-15 16:11:06,397 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-07-15 16:11:06,417 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43103] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-15 16:11:06,456 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-15 16:11:06,456 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-15 16:11:06,456 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-15 16:11:06,456 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-15 16:11:06,457 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 16:11:06,464 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-15 16:11:06,464 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-15 16:11:06,464 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-15 16:11:06,464 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-15 16:11:06,465 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-15 16:11:06,468 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 1.0820 sec 2023-07-15 16:11:06,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-15 16:11:06,514 INFO [Listener at jenkins-hbase4.apache.org/42699] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-07-15 16:11:06,514 DEBUG [Listener at jenkins-hbase4.apache.org/42699] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportWithTargetName get assigned. Timeout = 60000ms 2023-07-15 16:11:06,516 INFO [Listener at jenkins-hbase4.apache.org/42699] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 16:11:06,520 INFO [Listener at jenkins-hbase4.apache.org/42699] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportWithTargetName assigned to meta. Checking AM states. 2023-07-15 16:11:06,521 INFO [Listener at jenkins-hbase4.apache.org/42699] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 16:11:06,521 INFO [Listener at jenkins-hbase4.apache.org/42699] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportWithTargetName assigned. 2023-07-15 16:11:06,536 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-15 16:11:06,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689437466536 (current time:1689437466536). 2023-07-15 16:11:06,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 16:11:06,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] zookeeper.ReadOnlyZKClient(139): Connect 0x3ef86f7a to 127.0.0.1:58438 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 16:11:06,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@39e60153, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 16:11:06,545 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 16:11:06,547 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37448, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 16:11:06,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3ef86f7a to 127.0.0.1:58438 2023-07-15 16:11:06,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 16:11:06,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] zookeeper.ReadOnlyZKClient(139): Connect 0x1c9063d2 to 127.0.0.1:58438 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 16:11:06,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5d543725, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 16:11:06,557 DEBUG [hconnection-0x6cc5a958-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 16:11:06,559 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37464, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 16:11:06,565 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1c9063d2 to 127.0.0.1:58438 2023-07-15 16:11:06,565 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 16:11:06,565 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-15 16:11:06,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 16:11:06,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-15 16:11:06,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] procedure2.ProcedureExecutor(1029): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-15 16:11:06,615 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-15 16:11:06,617 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689438066617 2023-07-15 16:11:06,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-15 16:11:06,617 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-15 16:11:06,621 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-15 16:11:06,625 DEBUG [Listener at jenkins-hbase4.apache.org/42699] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 16:11:06,625 DEBUG [Listener at jenkins-hbase4.apache.org/42699] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 16:11:06,629 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-15 16:11:06,631 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 15 msec 2023-07-15 16:11:06,632 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-15 16:11:06,633 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689438066633 2023-07-15 16:11:06,662 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:06,662 INFO [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-07-15 16:11:06,662 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 16:11:06,663 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-07-15 16:11:06,663 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-15 16:11:06,664 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:06,664 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:06,670 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:11:06,670 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:11:06,670 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:11:06,670 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:11:06,670 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:11:06,670 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:11:06,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:11:06,670 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:11:06,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:11:06,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:11:06,670 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:11:06,671 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:06,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:06,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:06,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:06,671 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:06,671 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 16:11:06,672 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:06,672 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:06,672 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:06,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-15 16:11:06,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-15 16:11:06,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:06,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-15 16:11:06,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:06,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:06,673 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-15 16:11:06,673 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-15 16:11:06,673 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-15 16:11:06,675 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:06,675 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:06,675 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:06,675 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-15 16:11:06,675 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-15 16:11:06,676 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-15 16:11:06,676 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 16:11:06,676 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 16:11:06,676 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-15 16:11:06,675 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 16:11:06,677 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-15 16:11:06,678 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-15 16:11:06,678 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-15 16:11:06,677 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-15 16:11:06,678 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45149,1689437455062' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-15 16:11:06,678 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35773,1689437454990' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-15 16:11:06,678 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-15 16:11:06,678 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43103,1689437454905' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-15 16:11:06,681 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:06,681 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:06,681 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:11:06,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:11:06,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:11:06,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:11:06,682 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:06,682 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:06,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:11:06,682 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 16:11:06,682 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:06,682 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 16:11:06,682 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:06,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:11:06,682 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:06,682 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 16:11:06,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:06,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:11:06,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:11:06,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:06,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:11:06,685 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45149,1689437455062' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-15 16:11:06,685 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@e1ff167[Count = 1] remaining members to acquire global barrier 2023-07-15 16:11:06,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:06,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:11:06,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:11:06,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:11:06,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:11:06,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:06,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:11:06,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:11:06,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:06,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:11:06,688 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43103,1689437454905' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-15 16:11:06,688 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@e1ff167[Count = 0] remaining members to acquire global barrier 2023-07-15 16:11:06,688 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-15 16:11:06,688 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:06,690 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:06,690 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:06,690 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:06,690 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:06,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:06,690 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:06,690 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-15 16:11:06,690 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:06,690 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:11:06,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:06,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:06,690 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-15 16:11:06,690 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-15 16:11:06,690 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-15 16:11:06,690 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,35773,1689437454990' in zk 2023-07-15 16:11:06,690 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:06,690 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 16:11:06,694 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 16:11:06,695 DEBUG [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689437465382.1548cc56c4470f14e75dcf232af4c0a2. 2023-07-15 16:11:06,694 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 16:11:06,695 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 16:11:06,695 DEBUG [rs(jenkins-hbase4.apache.org,45149,1689437455062)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689437465382.09f9fe0470f39453610cd998c0d5aa1f. 2023-07-15 16:11:06,695 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 16:11:06,695 DEBUG [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689437465382.1548cc56c4470f14e75dcf232af4c0a2. started... 2023-07-15 16:11:06,695 DEBUG [rs(jenkins-hbase4.apache.org,45149,1689437455062)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689437465382.09f9fe0470f39453610cd998c0d5aa1f. started... 2023-07-15 16:11:06,698 DEBUG [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 1548cc56c4470f14e75dcf232af4c0a2: 2023-07-15 16:11:06,698 DEBUG [rs(jenkins-hbase4.apache.org,45149,1689437455062)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 09f9fe0470f39453610cd998c0d5aa1f: 2023-07-15 16:11:06,699 DEBUG [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689437465382.1548cc56c4470f14e75dcf232af4c0a2.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:06,699 DEBUG [rs(jenkins-hbase4.apache.org,45149,1689437455062)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689437465382.09f9fe0470f39453610cd998c0d5aa1f.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:06,700 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-15 16:11:06,700 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 16:11:06,700 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-15 16:11:06,705 DEBUG [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 16:11:06,705 DEBUG [rs(jenkins-hbase4.apache.org,45149,1689437455062)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 16:11:06,709 DEBUG [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-15 16:11:06,709 DEBUG [rs(jenkins-hbase4.apache.org,45149,1689437455062)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-15 16:11:06,726 DEBUG [Listener at jenkins-hbase4.apache.org/42699] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 16:11:06,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-15 16:11:06,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-15 16:11:06,744 DEBUG [Listener at jenkins-hbase4.apache.org/42699] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 16:11:06,745 DEBUG [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689437465382.1548cc56c4470f14e75dcf232af4c0a2. completed. 2023-07-15 16:11:06,745 DEBUG [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689437465382.1548cc56c4470f14e75dcf232af4c0a2. 2023-07-15 16:11:06,745 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 16:11:06,745 DEBUG [rs(jenkins-hbase4.apache.org,45149,1689437455062)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689437465382.09f9fe0470f39453610cd998c0d5aa1f. completed. 2023-07-15 16:11:06,745 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 16:11:06,746 DEBUG [rs(jenkins-hbase4.apache.org,45149,1689437455062)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689437465382.09f9fe0470f39453610cd998c0d5aa1f. 2023-07-15 16:11:06,746 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:06,746 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 16:11:06,746 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 16:11:06,746 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:11:06,746 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-15 16:11:06,746 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-15 16:11:06,746 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,43103,1689437454905' in zk 2023-07-15 16:11:06,746 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,45149,1689437455062' in zk 2023-07-15 16:11:06,748 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-15 16:11:06,748 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:11:06,748 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 16:11:06,748 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-15 16:11:06,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:11:06,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:11:06,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:11:06,750 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-15 16:11:06,750 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:06,750 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 16:11:06,750 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-15 16:11:06,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:11:06,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:11:06,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:06,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:11:06,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:11:06,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:06,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:11:06,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:06,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:11:06,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:11:06,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:06,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,45149,1689437455062': 2023-07-15 16:11:06,757 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45149,1689437455062' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-15 16:11:06,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:06,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:11:06,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:11:06,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:11:06,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:11:06,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:06,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:11:06,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:11:06,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:06,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:11:06,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:06,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:11:06,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:11:06,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:06,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,43103,1689437454905': 2023-07-15 16:11:06,762 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43103,1689437454905' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-15 16:11:06,762 INFO [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-07-15 16:11:06,762 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 16:11:06,762 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 16:11:06,762 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:06,762 INFO [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 16:11:06,765 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:06,765 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:06,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:06,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:06,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:06,765 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:11:06,765 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:11:06,765 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:06,765 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:06,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:06,766 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:11:06,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:11:06,766 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:11:06,766 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:06,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:06,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:06,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:11:06,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:11:06,766 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:11:06,766 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:11:06,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:11:06,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:06,767 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:11:06,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:11:06,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:11:06,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:06,767 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:11:06,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:06,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:06,768 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:06,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:11:06,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:06,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:11:06,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:11:06,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:06,769 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:11:06,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:11:06,770 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:11:06,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:06,771 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:06,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:11:06,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:11:06,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:06,784 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:11:06,784 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:11:06,784 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:11:06,784 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:11:06,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:11:06,784 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:06,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:11:06,784 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:06,784 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:11:06,784 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:11:06,784 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:11:06,784 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:11:06,785 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 16:11:06,785 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:06,784 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:11:06,784 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:06,785 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:06,785 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:06,785 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:11:06,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:11:06,785 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:11:06,785 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:06,785 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:11:06,785 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:11:06,785 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:06,786 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:06,786 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:11:06,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:11:06,787 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:11:06,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:11:06,787 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:11:06,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:11:06,788 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:06,827 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:06,870 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-15 16:11:06,870 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:06,871 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:06,871 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689437466617Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1689437466785 (+168 ms)Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1689437466785Writing data manifest for emptySnaptb0-testExportWithTargetName at 1689437466799 (+14 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1689437466817 (+18 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689437466870 (+53 ms) 2023-07-15 16:11:06,873 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-15 16:11:06,875 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 254 msec 2023-07-15 16:11:06,945 DEBUG [Listener at jenkins-hbase4.apache.org/42699] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 16:11:06,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-15 16:11:06,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 16:11:06,969 DEBUG [htable-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 16:11:06,975 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56170, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 16:11:06,976 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45149] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1689437465382.09f9fe0470f39453610cd998c0d5aa1f. with WAL disabled. Data may be lost in the event of a crash. 2023-07-15 16:11:06,977 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43103] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1689437465382.1548cc56c4470f14e75dcf232af4c0a2. with WAL disabled. Data may be lost in the event of a crash. 2023-07-15 16:11:06,984 DEBUG [Listener at jenkins-hbase4.apache.org/42699] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-15 16:11:06,985 DEBUG [Listener at jenkins-hbase4.apache.org/42699] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689437465382.09f9fe0470f39453610cd998c0d5aa1f. 2023-07-15 16:11:06,999 INFO [Listener at jenkins-hbase4.apache.org/42699] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 16:11:07,038 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-15 16:11:07,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689437467038 (current time:1689437467038). 2023-07-15 16:11:07,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 16:11:07,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] zookeeper.ReadOnlyZKClient(139): Connect 0x40c08646 to 127.0.0.1:58438 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 16:11:07,048 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7d20cc17, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 16:11:07,050 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 16:11:07,051 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37466, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 16:11:07,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x40c08646 to 127.0.0.1:58438 2023-07-15 16:11:07,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 16:11:07,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] zookeeper.ReadOnlyZKClient(139): Connect 0x2b5f496c to 127.0.0.1:58438 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 16:11:07,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6fe918f7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 16:11:07,061 DEBUG [hconnection-0x14523169-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 16:11:07,065 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37468, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 16:11:07,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2b5f496c to 127.0.0.1:58438 2023-07-15 16:11:07,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 16:11:07,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-15 16:11:07,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 16:11:07,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-15 16:11:07,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-15 16:11:07,076 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-15 16:11:07,077 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689438067077 2023-07-15 16:11:07,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-15 16:11:07,077 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-15 16:11:07,079 DEBUG [Listener at jenkins-hbase4.apache.org/42699] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 16:11:07,079 DEBUG [Listener at jenkins-hbase4.apache.org/42699] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 16:11:07,080 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-15 16:11:07,081 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-15 16:11:07,083 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 8 msec 2023-07-15 16:11:07,083 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-15 16:11:07,084 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689438067084 2023-07-15 16:11:07,100 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-07-15 16:11:07,100 INFO [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-07-15 16:11:07,100 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 16:11:07,101 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-07-15 16:11:07,101 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-15 16:11:07,101 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 16:11:07,101 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-15 16:11:07,103 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:11:07,103 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:11:07,103 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:11:07,103 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:11:07,103 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:11:07,103 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:11:07,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:11:07,103 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:11:07,103 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:11:07,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:11:07,103 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:07,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:11:07,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-15 16:11:07,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-15 16:11:07,104 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:07,104 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 16:11:07,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-15 16:11:07,104 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 16:11:07,104 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 16:11:07,104 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 16:11:07,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-15 16:11:07,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-15 16:11:07,105 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-15 16:11:07,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-15 16:11:07,105 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-15 16:11:07,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-15 16:11:07,105 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-15 16:11:07,105 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 16:11:07,105 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-15 16:11:07,106 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-15 16:11:07,106 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-15 16:11:07,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-15 16:11:07,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-15 16:11:07,106 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45149,1689437455062' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-15 16:11:07,106 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-15 16:11:07,106 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-15 16:11:07,106 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-15 16:11:07,106 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 16:11:07,107 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-15 16:11:07,107 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-15 16:11:07,107 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-15 16:11:07,107 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-15 16:11:07,107 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 16:11:07,107 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35773,1689437454990' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-15 16:11:07,108 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-15 16:11:07,108 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-15 16:11:07,108 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43103,1689437454905' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-15 16:11:07,110 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:11:07,110 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 16:11:07,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:11:07,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:11:07,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:11:07,111 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 16:11:07,111 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 16:11:07,111 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 16:11:07,111 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:07,111 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 16:11:07,112 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 16:11:07,112 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 16:11:07,112 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 16:11:07,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:11:07,112 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 16:11:07,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:11:07,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-15 16:11:07,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:11:07,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:11:07,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:07,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:11:07,114 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45149,1689437455062' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-15 16:11:07,114 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7c82a7d3[Count = 1] remaining members to acquire global barrier 2023-07-15 16:11:07,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:07,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:11:07,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:11:07,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:11:07,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:11:07,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-15 16:11:07,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:11:07,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:11:07,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:07,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:11:07,117 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43103,1689437454905' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-15 16:11:07,117 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7c82a7d3[Count = 0] remaining members to acquire global barrier 2023-07-15 16:11:07,117 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-15 16:11:07,118 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 16:11:07,123 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 16:11:07,123 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 16:11:07,123 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 16:11:07,123 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 16:11:07,123 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 16:11:07,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 16:11:07,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 16:11:07,124 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-15 16:11:07,124 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-15 16:11:07,124 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 16:11:07,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 16:11:07,124 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 16:11:07,124 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 16:11:07,124 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:11:07,124 DEBUG [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689437465382.1548cc56c4470f14e75dcf232af4c0a2. 2023-07-15 16:11:07,124 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-15 16:11:07,124 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-15 16:11:07,124 DEBUG [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689437465382.1548cc56c4470f14e75dcf232af4c0a2. started... 2023-07-15 16:11:07,124 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,35773,1689437454990' in zk 2023-07-15 16:11:07,124 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:07,125 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 16:11:07,125 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 16:11:07,125 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 16:11:07,125 DEBUG [rs(jenkins-hbase4.apache.org,45149,1689437455062)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689437465382.09f9fe0470f39453610cd998c0d5aa1f. 2023-07-15 16:11:07,125 INFO [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 1548cc56c4470f14e75dcf232af4c0a2 1/1 column families, dataSize=2.87 KB heapSize=6.44 KB 2023-07-15 16:11:07,125 DEBUG [rs(jenkins-hbase4.apache.org,45149,1689437455062)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689437465382.09f9fe0470f39453610cd998c0d5aa1f. started... 2023-07-15 16:11:07,125 INFO [rs(jenkins-hbase4.apache.org,45149,1689437455062)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 09f9fe0470f39453610cd998c0d5aa1f 1/1 column families, dataSize=400 B heapSize=1.09 KB 2023-07-15 16:11:07,127 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-15 16:11:07,127 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 16:11:07,127 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-15 16:11:07,179 DEBUG [Listener at jenkins-hbase4.apache.org/42699] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 16:11:07,181 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-15 16:11:07,181 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-15 16:11:07,182 DEBUG [Listener at jenkins-hbase4.apache.org/42699] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 16:11:07,239 INFO [rs(jenkins-hbase4.apache.org,45149,1689437455062)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=400 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportWithTargetName/09f9fe0470f39453610cd998c0d5aa1f/.tmp/cf/46fa1bd586d0499580426545685e2e51 2023-07-15 16:11:07,239 INFO [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.87 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportWithTargetName/1548cc56c4470f14e75dcf232af4c0a2/.tmp/cf/0d581eed5ff343caa73eb9a1614042b3 2023-07-15 16:11:07,298 DEBUG [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportWithTargetName/1548cc56c4470f14e75dcf232af4c0a2/.tmp/cf/0d581eed5ff343caa73eb9a1614042b3 as hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportWithTargetName/1548cc56c4470f14e75dcf232af4c0a2/cf/0d581eed5ff343caa73eb9a1614042b3 2023-07-15 16:11:07,298 DEBUG [rs(jenkins-hbase4.apache.org,45149,1689437455062)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportWithTargetName/09f9fe0470f39453610cd998c0d5aa1f/.tmp/cf/46fa1bd586d0499580426545685e2e51 as hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportWithTargetName/09f9fe0470f39453610cd998c0d5aa1f/cf/46fa1bd586d0499580426545685e2e51 2023-07-15 16:11:07,309 INFO [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportWithTargetName/1548cc56c4470f14e75dcf232af4c0a2/cf/0d581eed5ff343caa73eb9a1614042b3, entries=44, sequenceid=6, filesize=7.8 K 2023-07-15 16:11:07,312 INFO [rs(jenkins-hbase4.apache.org,45149,1689437455062)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportWithTargetName/09f9fe0470f39453610cd998c0d5aa1f/cf/46fa1bd586d0499580426545685e2e51, entries=6, sequenceid=6, filesize=5.2 K 2023-07-15 16:11:07,316 INFO [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.87 KB/2936, heapSize ~6.42 KB/6576, currentSize=0 B/0 for 1548cc56c4470f14e75dcf232af4c0a2 in 190ms, sequenceid=6, compaction requested=false 2023-07-15 16:11:07,316 DEBUG [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-15 16:11:07,316 INFO [rs(jenkins-hbase4.apache.org,45149,1689437455062)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~400 B/400, heapSize ~1.08 KB/1104, currentSize=0 B/0 for 09f9fe0470f39453610cd998c0d5aa1f in 191ms, sequenceid=6, compaction requested=false 2023-07-15 16:11:07,316 DEBUG [rs(jenkins-hbase4.apache.org,45149,1689437455062)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-15 16:11:07,318 DEBUG [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 1548cc56c4470f14e75dcf232af4c0a2: 2023-07-15 16:11:07,318 DEBUG [rs(jenkins-hbase4.apache.org,45149,1689437455062)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 09f9fe0470f39453610cd998c0d5aa1f: 2023-07-15 16:11:07,319 DEBUG [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689437465382.1548cc56c4470f14e75dcf232af4c0a2.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-15 16:11:07,319 DEBUG [rs(jenkins-hbase4.apache.org,45149,1689437455062)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689437465382.09f9fe0470f39453610cd998c0d5aa1f.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-15 16:11:07,319 DEBUG [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 16:11:07,319 DEBUG [rs(jenkins-hbase4.apache.org,45149,1689437455062)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 16:11:07,319 DEBUG [rs(jenkins-hbase4.apache.org,45149,1689437455062)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportWithTargetName/09f9fe0470f39453610cd998c0d5aa1f/cf/46fa1bd586d0499580426545685e2e51] hfiles 2023-07-15 16:11:07,319 DEBUG [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportWithTargetName/1548cc56c4470f14e75dcf232af4c0a2/cf/0d581eed5ff343caa73eb9a1614042b3] hfiles 2023-07-15 16:11:07,319 DEBUG [rs(jenkins-hbase4.apache.org,45149,1689437455062)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportWithTargetName/09f9fe0470f39453610cd998c0d5aa1f/cf/46fa1bd586d0499580426545685e2e51 for snapshot=snaptb0-testExportWithTargetName 2023-07-15 16:11:07,319 DEBUG [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportWithTargetName/1548cc56c4470f14e75dcf232af4c0a2/cf/0d581eed5ff343caa73eb9a1614042b3 for snapshot=snaptb0-testExportWithTargetName 2023-07-15 16:11:07,381 DEBUG [rs(jenkins-hbase4.apache.org,45149,1689437455062)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689437465382.09f9fe0470f39453610cd998c0d5aa1f. completed. 2023-07-15 16:11:07,381 DEBUG [rs(jenkins-hbase4.apache.org,45149,1689437455062)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689437465382.09f9fe0470f39453610cd998c0d5aa1f. 2023-07-15 16:11:07,382 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 16:11:07,382 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 16:11:07,382 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:11:07,382 DEBUG [Listener at jenkins-hbase4.apache.org/42699] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 16:11:07,382 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-15 16:11:07,382 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,45149,1689437455062' in zk 2023-07-15 16:11:07,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-15 16:11:07,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-15 16:11:07,389 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:11:07,389 DEBUG [Listener at jenkins-hbase4.apache.org/42699] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-15 16:11:07,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:11:07,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:11:07,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:11:07,389 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-15 16:11:07,389 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 16:11:07,389 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-15 16:11:07,391 DEBUG [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689437465382.1548cc56c4470f14e75dcf232af4c0a2. completed. 2023-07-15 16:11:07,391 DEBUG [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689437465382.1548cc56c4470f14e75dcf232af4c0a2. 2023-07-15 16:11:07,392 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 16:11:07,392 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 16:11:07,392 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:07,392 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-15 16:11:07,392 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,43103,1689437454905' in zk 2023-07-15 16:11:07,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:11:07,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:11:07,400 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:07,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-15 16:11:07,400 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-15 16:11:07,400 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 16:11:07,400 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-15 16:11:07,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:11:07,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:11:07,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:07,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:11:07,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-15 16:11:07,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:11:07,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:11:07,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:07,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,45149,1689437455062': 2023-07-15 16:11:07,407 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45149,1689437455062' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-15 16:11:07,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:07,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:11:07,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:11:07,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:11:07,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:11:07,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-15 16:11:07,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:11:07,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:11:07,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:07,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:11:07,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-15 16:11:07,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:11:07,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:11:07,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:07,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,43103,1689437454905': 2023-07-15 16:11:07,412 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43103,1689437454905' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-15 16:11:07,412 INFO [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-07-15 16:11:07,412 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 16:11:07,412 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 16:11:07,412 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-07-15 16:11:07,412 INFO [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 16:11:07,415 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 16:11:07,415 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 16:11:07,415 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:11:07,415 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 16:11:07,415 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 16:11:07,415 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:11:07,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 16:11:07,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:11:07,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:11:07,415 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 16:11:07,415 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 16:11:07,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 16:11:07,416 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 16:11:07,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 16:11:07,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 16:11:07,416 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:11:07,416 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:11:07,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:11:07,416 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:11:07,416 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:11:07,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:11:07,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:11:07,418 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:11:07,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:11:07,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 16:11:07,419 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:11:07,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-15 16:11:07,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 16:11:07,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 16:11:07,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:11:07,419 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:07,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-15 16:11:07,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:11:07,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:11:07,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:07,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:11:07,423 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:11:07,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-15 16:11:07,423 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:11:07,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:11:07,424 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:07,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:11:07,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:07,436 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:07,436 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-15 16:11:07,436 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:11:07,437 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:11:07,437 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:11:07,437 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:11:07,437 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-07-15 16:11:07,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:11:07,437 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-07-15 16:11:07,437 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:11:07,437 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:11:07,437 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 16:11:07,437 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:11:07,437 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:11:07,437 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:11:07,438 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:11:07,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:11:07,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:11:07,438 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:11:07,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:11:07,438 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-15 16:11:07,438 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:11:07,439 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:07,439 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 16:11:07,439 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:11:07,439 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:11:07,439 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 16:11:07,439 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:11:07,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:11:07,439 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 16:11:07,439 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:11:07,439 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-15 16:11:07,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:11:07,485 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-15 16:11:07,539 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-15 16:11:07,539 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-15 16:11:07,540 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-15 16:11:07,540 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689437467077Consolidate snapshot: snaptb0-testExportWithTargetName at 1689437467437 (+360 ms)Loading Region manifests for snaptb0-testExportWithTargetName at 1689437467437Writing data manifest for snaptb0-testExportWithTargetName at 1689437467450 (+13 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1689437467470 (+20 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689437467539 (+69 ms) 2023-07-15 16:11:07,542 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-15 16:11:07,544 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 464 msec 2023-07-15 16:11:07,689 DEBUG [Listener at jenkins-hbase4.apache.org/42699] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 16:11:07,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-15 16:11:07,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 16:11:07,692 INFO [Listener at jenkins-hbase4.apache.org/42699] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/export-test/export-1689437467692 2023-07-15 16:11:07,692 INFO [Listener at jenkins-hbase4.apache.org/42699] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:44749, tgtDir=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/export-test/export-1689437467692, rawTgtDir=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/export-test/export-1689437467692, srcFsUri=hdfs://localhost:44749, srcDir=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8 2023-07-15 16:11:07,734 DEBUG [Listener at jenkins-hbase4.apache.org/42699] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44749, inputRoot=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8 2023-07-15 16:11:07,734 DEBUG [Listener at jenkins-hbase4.apache.org/42699] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_273372122_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/export-test/export-1689437467692, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/export-test/export-1689437467692/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-15 16:11:07,734 INFO [Listener at jenkins-hbase4.apache.org/42699] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44749, inputRoot=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8, snapshotDir=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-07-15 16:11:07,750 INFO [Listener at jenkins-hbase4.apache.org/42699] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/export-test/export-1689437467692/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-15 16:11:07,818 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-15 16:11:07,818 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-15 16:11:07,819 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-15 16:11:07,819 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-15 16:11:08,856 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1587f29c-5daf-234a-1773-5088522b715e/hadoop-196831941013896121.jar 2023-07-15 16:11:08,857 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-15 16:11:08,857 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-15 16:11:08,938 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1587f29c-5daf-234a-1773-5088522b715e/hadoop-1476218188624989386.jar 2023-07-15 16:11:08,938 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-15 16:11:08,939 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-15 16:11:08,939 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-15 16:11:08,940 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-15 16:11:08,940 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-15 16:11:08,941 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-15 16:11:08,941 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-15 16:11:08,942 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-15 16:11:08,942 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-15 16:11:08,943 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-15 16:11:08,943 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-15 16:11:08,944 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-15 16:11:08,944 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-15 16:11:08,944 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-15 16:11:08,945 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-15 16:11:08,945 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-15 16:11:08,949 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 16:11:08,950 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 16:11:08,950 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 16:11:08,950 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 16:11:08,951 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 16:11:08,951 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 16:11:08,951 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 16:11:10,367 WARN [Listener at jenkins-hbase4.apache.org/42699] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-15 16:11:10,373 INFO [Listener at jenkins-hbase4.apache.org/42699] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-07-15 16:11:10,385 DEBUG [Listener at jenkins-hbase4.apache.org/42699] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-15 16:11:10,948 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 16:11:10,949 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 16:11:11,461 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689437464006_0001_000001 (auth:SIMPLE) 2023-07-15 16:11:11,855 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-15 16:11:16,743 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689437464006_0001_000001 (auth:SIMPLE) 2023-07-15 16:11:19,026 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689437464006_0001_000001 (auth:SIMPLE) 2023-07-15 16:11:22,543 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689437464006_0001_000001 (auth:SIMPLE) 2023-07-15 16:11:24,358 INFO [Listener at jenkins-hbase4.apache.org/42699] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-15 16:11:24,361 INFO [Listener at jenkins-hbase4.apache.org/42699] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-15 16:11:24,370 INFO [Listener at jenkins-hbase4.apache.org/42699] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-07-15 16:11:24,371 INFO [Listener at jenkins-hbase4.apache.org/42699] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-15 16:11:24,371 INFO [Listener at jenkins-hbase4.apache.org/42699] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-15 16:11:24,372 DEBUG [Listener at jenkins-hbase4.apache.org/42699] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-127961896_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-15 16:11:24,372 DEBUG [Listener at jenkins-hbase4.apache.org/42699] snapshot.TestExportSnapshot(367): hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-07-15 16:11:24,372 DEBUG [Listener at jenkins-hbase4.apache.org/42699] snapshot.TestExportSnapshot(367): hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-07-15 16:11:24,372 DEBUG [Listener at jenkins-hbase4.apache.org/42699] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-127961896_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/export-test/export-1689437467692/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/export-test/export-1689437467692/.hbase-snapshot/testExportWithTargetName 2023-07-15 16:11:24,373 DEBUG [Listener at jenkins-hbase4.apache.org/42699] snapshot.TestExportSnapshot(367): hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/export-test/export-1689437467692/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-07-15 16:11:24,373 DEBUG [Listener at jenkins-hbase4.apache.org/42699] snapshot.TestExportSnapshot(367): hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/export-test/export-1689437467692/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-07-15 16:11:24,384 INFO [Listener at jenkins-hbase4.apache.org/42699] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-07-15 16:11:24,389 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-07-15 16:11:24,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-07-15 16:11:24,404 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689437484404"}]},"ts":"1689437484404"} 2023-07-15 16:11:24,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-15 16:11:24,406 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-07-15 16:11:24,409 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-07-15 16:11:24,411 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=09f9fe0470f39453610cd998c0d5aa1f, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=1548cc56c4470f14e75dcf232af4c0a2, UNASSIGN}] 2023-07-15 16:11:24,414 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=1548cc56c4470f14e75dcf232af4c0a2, UNASSIGN 2023-07-15 16:11:24,414 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=09f9fe0470f39453610cd998c0d5aa1f, UNASSIGN 2023-07-15 16:11:24,415 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=1548cc56c4470f14e75dcf232af4c0a2, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:24,415 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=09f9fe0470f39453610cd998c0d5aa1f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:11:24,415 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689437465382.1548cc56c4470f14e75dcf232af4c0a2.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689437484415"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689437484415"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689437484415"}]},"ts":"1689437484415"} 2023-07-15 16:11:24,415 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689437465382.09f9fe0470f39453610cd998c0d5aa1f.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689437484415"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689437484415"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689437484415"}]},"ts":"1689437484415"} 2023-07-15 16:11:24,417 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE; CloseRegionProcedure 1548cc56c4470f14e75dcf232af4c0a2, server=jenkins-hbase4.apache.org,43103,1689437454905}] 2023-07-15 16:11:24,418 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=22, state=RUNNABLE; CloseRegionProcedure 09f9fe0470f39453610cd998c0d5aa1f, server=jenkins-hbase4.apache.org,45149,1689437455062}] 2023-07-15 16:11:24,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-15 16:11:24,579 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 09f9fe0470f39453610cd998c0d5aa1f 2023-07-15 16:11:24,579 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 1548cc56c4470f14e75dcf232af4c0a2 2023-07-15 16:11:24,579 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 09f9fe0470f39453610cd998c0d5aa1f, disabling compactions & flushes 2023-07-15 16:11:24,579 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1548cc56c4470f14e75dcf232af4c0a2, disabling compactions & flushes 2023-07-15 16:11:24,579 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689437465382.09f9fe0470f39453610cd998c0d5aa1f. 2023-07-15 16:11:24,579 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689437465382.1548cc56c4470f14e75dcf232af4c0a2. 2023-07-15 16:11:24,579 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689437465382.09f9fe0470f39453610cd998c0d5aa1f. 2023-07-15 16:11:24,579 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689437465382.1548cc56c4470f14e75dcf232af4c0a2. 2023-07-15 16:11:24,579 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689437465382.09f9fe0470f39453610cd998c0d5aa1f. after waiting 0 ms 2023-07-15 16:11:24,579 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689437465382.1548cc56c4470f14e75dcf232af4c0a2. after waiting 0 ms 2023-07-15 16:11:24,579 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689437465382.09f9fe0470f39453610cd998c0d5aa1f. 2023-07-15 16:11:24,579 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689437465382.1548cc56c4470f14e75dcf232af4c0a2. 2023-07-15 16:11:24,597 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportWithTargetName/09f9fe0470f39453610cd998c0d5aa1f/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 16:11:24,597 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportWithTargetName/1548cc56c4470f14e75dcf232af4c0a2/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 16:11:24,598 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 16:11:24,598 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 16:11:24,599 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689437465382.09f9fe0470f39453610cd998c0d5aa1f. 2023-07-15 16:11:24,599 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689437465382.1548cc56c4470f14e75dcf232af4c0a2. 2023-07-15 16:11:24,599 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 09f9fe0470f39453610cd998c0d5aa1f: 2023-07-15 16:11:24,599 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1548cc56c4470f14e75dcf232af4c0a2: 2023-07-15 16:11:24,602 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 1548cc56c4470f14e75dcf232af4c0a2 2023-07-15 16:11:24,603 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=1548cc56c4470f14e75dcf232af4c0a2, regionState=CLOSED 2023-07-15 16:11:24,603 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689437465382.1548cc56c4470f14e75dcf232af4c0a2.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689437484603"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689437484603"}]},"ts":"1689437484603"} 2023-07-15 16:11:24,605 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 09f9fe0470f39453610cd998c0d5aa1f 2023-07-15 16:11:24,606 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=09f9fe0470f39453610cd998c0d5aa1f, regionState=CLOSED 2023-07-15 16:11:24,606 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689437465382.09f9fe0470f39453610cd998c0d5aa1f.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689437484606"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689437484606"}]},"ts":"1689437484606"} 2023-07-15 16:11:24,608 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=23 2023-07-15 16:11:24,609 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=23, state=SUCCESS; CloseRegionProcedure 1548cc56c4470f14e75dcf232af4c0a2, server=jenkins-hbase4.apache.org,43103,1689437454905 in 188 msec 2023-07-15 16:11:24,611 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=1548cc56c4470f14e75dcf232af4c0a2, UNASSIGN in 197 msec 2023-07-15 16:11:24,612 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=22 2023-07-15 16:11:24,613 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=22, state=SUCCESS; CloseRegionProcedure 09f9fe0470f39453610cd998c0d5aa1f, server=jenkins-hbase4.apache.org,45149,1689437455062 in 190 msec 2023-07-15 16:11:24,616 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=21 2023-07-15 16:11:24,616 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=09f9fe0470f39453610cd998c0d5aa1f, UNASSIGN in 202 msec 2023-07-15 16:11:24,619 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689437484619"}]},"ts":"1689437484619"} 2023-07-15 16:11:24,621 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-07-15 16:11:24,622 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-07-15 16:11:24,625 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 230 msec 2023-07-15 16:11:24,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-15 16:11:24,708 INFO [Listener at jenkins-hbase4.apache.org/42699] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-07-15 16:11:24,713 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-07-15 16:11:24,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-15 16:11:24,725 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-15 16:11:24,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-07-15 16:11:24,727 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-15 16:11:24,731 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43103] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-07-15 16:11:24,734 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testExportWithTargetName/09f9fe0470f39453610cd998c0d5aa1f 2023-07-15 16:11:24,734 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testExportWithTargetName/1548cc56c4470f14e75dcf232af4c0a2 2023-07-15 16:11:24,734 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-15 16:11:24,734 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-15 16:11:24,735 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-15 16:11:24,735 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-15 16:11:24,735 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-15 16:11:24,735 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-15 16:11:24,735 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-15 16:11:24,735 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-15 16:11:24,736 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-15 16:11:24,736 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-15 16:11:24,737 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-15 16:11:24,737 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 16:11:24,737 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 16:11:24,737 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 16:11:24,738 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-15 16:11:24,738 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 16:11:24,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-15 16:11:24,740 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testExportWithTargetName/09f9fe0470f39453610cd998c0d5aa1f/cf, FileablePath, hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testExportWithTargetName/09f9fe0470f39453610cd998c0d5aa1f/recovered.edits] 2023-07-15 16:11:24,740 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testExportWithTargetName/1548cc56c4470f14e75dcf232af4c0a2/cf, FileablePath, hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testExportWithTargetName/1548cc56c4470f14e75dcf232af4c0a2/recovered.edits] 2023-07-15 16:11:24,748 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testExportWithTargetName/1548cc56c4470f14e75dcf232af4c0a2/cf/0d581eed5ff343caa73eb9a1614042b3 to hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/archive/data/default/testtb-testExportWithTargetName/1548cc56c4470f14e75dcf232af4c0a2/cf/0d581eed5ff343caa73eb9a1614042b3 2023-07-15 16:11:24,749 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testExportWithTargetName/09f9fe0470f39453610cd998c0d5aa1f/cf/46fa1bd586d0499580426545685e2e51 to hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/archive/data/default/testtb-testExportWithTargetName/09f9fe0470f39453610cd998c0d5aa1f/cf/46fa1bd586d0499580426545685e2e51 2023-07-15 16:11:24,754 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testExportWithTargetName/1548cc56c4470f14e75dcf232af4c0a2/recovered.edits/9.seqid to hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/archive/data/default/testtb-testExportWithTargetName/1548cc56c4470f14e75dcf232af4c0a2/recovered.edits/9.seqid 2023-07-15 16:11:24,754 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testExportWithTargetName/09f9fe0470f39453610cd998c0d5aa1f/recovered.edits/9.seqid to hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/archive/data/default/testtb-testExportWithTargetName/09f9fe0470f39453610cd998c0d5aa1f/recovered.edits/9.seqid 2023-07-15 16:11:24,754 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testExportWithTargetName/1548cc56c4470f14e75dcf232af4c0a2 2023-07-15 16:11:24,755 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testExportWithTargetName/09f9fe0470f39453610cd998c0d5aa1f 2023-07-15 16:11:24,755 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-15 16:11:24,758 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-15 16:11:24,781 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-07-15 16:11:24,784 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-07-15 16:11:24,785 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-15 16:11:24,785 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-07-15 16:11:24,786 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1689437465382.09f9fe0470f39453610cd998c0d5aa1f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689437484785"}]},"ts":"9223372036854775807"} 2023-07-15 16:11:24,786 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1689437465382.1548cc56c4470f14e75dcf232af4c0a2.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689437484785"}]},"ts":"9223372036854775807"} 2023-07-15 16:11:24,788 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-15 16:11:24,788 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 09f9fe0470f39453610cd998c0d5aa1f, NAME => 'testtb-testExportWithTargetName,,1689437465382.09f9fe0470f39453610cd998c0d5aa1f.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 1548cc56c4470f14e75dcf232af4c0a2, NAME => 'testtb-testExportWithTargetName,1,1689437465382.1548cc56c4470f14e75dcf232af4c0a2.', STARTKEY => '1', ENDKEY => ''}] 2023-07-15 16:11:24,788 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-07-15 16:11:24,788 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689437484788"}]},"ts":"9223372036854775807"} 2023-07-15 16:11:24,790 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-07-15 16:11:24,793 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-15 16:11:24,794 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 78 msec 2023-07-15 16:11:24,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-15 16:11:24,841 INFO [Listener at jenkins-hbase4.apache.org/42699] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-07-15 16:11:24,859 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-07-15 16:11:24,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:24,865 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-07-15 16:11:24,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-07-15 16:11:24,897 INFO [Listener at jenkins-hbase4.apache.org/42699] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportWithTargetName Thread=753 (was 706) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: Thread-1281 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-127961896_17 at /127.0.0.1:53700 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-127961896_17 at /127.0.0.1:46504 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x606da78-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_710076609_1 at /127.0.0.1:46470 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1587f29c-5daf-234a-1773-5088522b715e/cluster_a516de2a-eb5f-f2ef-952b-8cb73b2d461b/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1587f29c-5daf-234a-1773-5088522b715e/cluster_a516de2a-eb5f-f2ef-952b-8cb73b2d461b/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1587f29c-5daf-234a-1773-5088522b715e/cluster_a516de2a-eb5f-f2ef-952b-8cb73b2d461b/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x606da78-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-127961896_17 at /127.0.0.1:44292 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x606da78-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1587f29c-5daf-234a-1773-5088522b715e/cluster_a516de2a-eb5f-f2ef-952b-8cb73b2d461b/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x606da78-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1012686161) connection to jenkins-hbase4.apache.org/172.31.14.131:32957 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (1012686161) connection to jenkins-hbase4.apache.org/172.31.14.131:43253 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1012686161) connection to jenkins-hbase4.apache.org/172.31.14.131:44619 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: (jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1587f29c-5daf-234a-1773-5088522b715e/cluster_a516de2a-eb5f-f2ef-952b-8cb73b2d461b/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1587f29c-5daf-234a-1773-5088522b715e/cluster_a516de2a-eb5f-f2ef-952b-8cb73b2d461b/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=925 (was 892) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=449 (was 290) - SystemLoadAverage LEAK? -, ProcessCount=183 (was 177) - ProcessCount LEAK? -, AvailableMemoryMB=3140 (was 4934) 2023-07-15 16:11:24,898 WARN [Listener at jenkins-hbase4.apache.org/42699] hbase.ResourceChecker(130): Thread=753 is superior to 500 2023-07-15 16:11:24,921 INFO [Listener at jenkins-hbase4.apache.org/42699] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemState Thread=753, OpenFileDescriptor=925, MaxFileDescriptor=60000, SystemLoadAverage=449, ProcessCount=183, AvailableMemoryMB=3139 2023-07-15 16:11:24,921 WARN [Listener at jenkins-hbase4.apache.org/42699] hbase.ResourceChecker(130): Thread=753 is superior to 500 2023-07-15 16:11:24,923 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-15 16:11:24,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-07-15 16:11:24,930 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-15 16:11:24,930 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-07-15 16:11:24,931 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-15 16:11:24,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-15 16:11:24,934 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testExportFileSystemState/6216bbc3d263afb15d19f28122124a7c 2023-07-15 16:11:24,934 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testExportFileSystemState/c9b1e4dfee684fb8e5ed468df71dc95f 2023-07-15 16:11:24,935 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testExportFileSystemState/6216bbc3d263afb15d19f28122124a7c empty. 2023-07-15 16:11:24,935 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testExportFileSystemState/c9b1e4dfee684fb8e5ed468df71dc95f empty. 2023-07-15 16:11:24,935 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testExportFileSystemState/6216bbc3d263afb15d19f28122124a7c 2023-07-15 16:11:24,935 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testExportFileSystemState/c9b1e4dfee684fb8e5ed468df71dc95f 2023-07-15 16:11:24,935 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-15 16:11:24,955 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-15 16:11:24,956 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 6216bbc3d263afb15d19f28122124a7c, NAME => 'testtb-testExportFileSystemState,,1689437484923.6216bbc3d263afb15d19f28122124a7c.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp 2023-07-15 16:11:24,957 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => c9b1e4dfee684fb8e5ed468df71dc95f, NAME => 'testtb-testExportFileSystemState,1,1689437484923.c9b1e4dfee684fb8e5ed468df71dc95f.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp 2023-07-15 16:11:24,980 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689437484923.6216bbc3d263afb15d19f28122124a7c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 16:11:24,981 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 6216bbc3d263afb15d19f28122124a7c, disabling compactions & flushes 2023-07-15 16:11:24,981 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689437484923.6216bbc3d263afb15d19f28122124a7c. 2023-07-15 16:11:24,981 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689437484923.6216bbc3d263afb15d19f28122124a7c. 2023-07-15 16:11:24,981 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689437484923.6216bbc3d263afb15d19f28122124a7c. after waiting 0 ms 2023-07-15 16:11:24,981 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689437484923.6216bbc3d263afb15d19f28122124a7c. 2023-07-15 16:11:24,981 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689437484923.6216bbc3d263afb15d19f28122124a7c. 2023-07-15 16:11:24,981 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 6216bbc3d263afb15d19f28122124a7c: 2023-07-15 16:11:25,032 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-15 16:11:25,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-15 16:11:25,382 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689437484923.c9b1e4dfee684fb8e5ed468df71dc95f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 16:11:25,382 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing c9b1e4dfee684fb8e5ed468df71dc95f, disabling compactions & flushes 2023-07-15 16:11:25,382 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689437484923.c9b1e4dfee684fb8e5ed468df71dc95f. 2023-07-15 16:11:25,382 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689437484923.c9b1e4dfee684fb8e5ed468df71dc95f. 2023-07-15 16:11:25,382 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689437484923.c9b1e4dfee684fb8e5ed468df71dc95f. after waiting 0 ms 2023-07-15 16:11:25,382 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689437484923.c9b1e4dfee684fb8e5ed468df71dc95f. 2023-07-15 16:11:25,383 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689437484923.c9b1e4dfee684fb8e5ed468df71dc95f. 2023-07-15 16:11:25,383 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for c9b1e4dfee684fb8e5ed468df71dc95f: 2023-07-15 16:11:25,385 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-15 16:11:25,386 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689437484923.6216bbc3d263afb15d19f28122124a7c.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689437485386"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689437485386"}]},"ts":"1689437485386"} 2023-07-15 16:11:25,387 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689437484923.c9b1e4dfee684fb8e5ed468df71dc95f.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689437485386"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689437485386"}]},"ts":"1689437485386"} 2023-07-15 16:11:25,389 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-15 16:11:25,390 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-15 16:11:25,391 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689437485391"}]},"ts":"1689437485391"} 2023-07-15 16:11:25,392 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-07-15 16:11:25,399 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-15 16:11:25,400 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-15 16:11:25,400 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-15 16:11:25,401 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-15 16:11:25,401 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-15 16:11:25,401 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6216bbc3d263afb15d19f28122124a7c, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=c9b1e4dfee684fb8e5ed468df71dc95f, ASSIGN}] 2023-07-15 16:11:25,404 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6216bbc3d263afb15d19f28122124a7c, ASSIGN 2023-07-15 16:11:25,404 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=c9b1e4dfee684fb8e5ed468df71dc95f, ASSIGN 2023-07-15 16:11:25,405 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6216bbc3d263afb15d19f28122124a7c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43103,1689437454905; forceNewPlan=false, retain=false 2023-07-15 16:11:25,405 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=c9b1e4dfee684fb8e5ed468df71dc95f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45149,1689437455062; forceNewPlan=false, retain=false 2023-07-15 16:11:25,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-15 16:11:25,555 INFO [jenkins-hbase4:37255] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-15 16:11:25,558 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=6216bbc3d263afb15d19f28122124a7c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:25,558 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=c9b1e4dfee684fb8e5ed468df71dc95f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:11:25,558 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689437484923.6216bbc3d263afb15d19f28122124a7c.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689437485558"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689437485558"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689437485558"}]},"ts":"1689437485558"} 2023-07-15 16:11:25,559 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689437484923.c9b1e4dfee684fb8e5ed468df71dc95f.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689437485558"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689437485558"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689437485558"}]},"ts":"1689437485558"} 2023-07-15 16:11:25,561 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=28, state=RUNNABLE; OpenRegionProcedure 6216bbc3d263afb15d19f28122124a7c, server=jenkins-hbase4.apache.org,43103,1689437454905}] 2023-07-15 16:11:25,562 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=29, state=RUNNABLE; OpenRegionProcedure c9b1e4dfee684fb8e5ed468df71dc95f, server=jenkins-hbase4.apache.org,45149,1689437455062}] 2023-07-15 16:11:25,717 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1689437484923.c9b1e4dfee684fb8e5ed468df71dc95f. 2023-07-15 16:11:25,718 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c9b1e4dfee684fb8e5ed468df71dc95f, NAME => 'testtb-testExportFileSystemState,1,1689437484923.c9b1e4dfee684fb8e5ed468df71dc95f.', STARTKEY => '1', ENDKEY => ''} 2023-07-15 16:11:25,718 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1689437484923.c9b1e4dfee684fb8e5ed468df71dc95f. service=AccessControlService 2023-07-15 16:11:25,718 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 16:11:25,718 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState c9b1e4dfee684fb8e5ed468df71dc95f 2023-07-15 16:11:25,718 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689437484923.c9b1e4dfee684fb8e5ed468df71dc95f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 16:11:25,718 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c9b1e4dfee684fb8e5ed468df71dc95f 2023-07-15 16:11:25,718 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c9b1e4dfee684fb8e5ed468df71dc95f 2023-07-15 16:11:25,719 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1689437484923.6216bbc3d263afb15d19f28122124a7c. 2023-07-15 16:11:25,720 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6216bbc3d263afb15d19f28122124a7c, NAME => 'testtb-testExportFileSystemState,,1689437484923.6216bbc3d263afb15d19f28122124a7c.', STARTKEY => '', ENDKEY => '1'} 2023-07-15 16:11:25,720 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1689437484923.6216bbc3d263afb15d19f28122124a7c. service=AccessControlService 2023-07-15 16:11:25,720 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 16:11:25,721 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 6216bbc3d263afb15d19f28122124a7c 2023-07-15 16:11:25,721 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689437484923.6216bbc3d263afb15d19f28122124a7c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 16:11:25,721 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6216bbc3d263afb15d19f28122124a7c 2023-07-15 16:11:25,721 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6216bbc3d263afb15d19f28122124a7c 2023-07-15 16:11:25,723 INFO [StoreOpener-c9b1e4dfee684fb8e5ed468df71dc95f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region c9b1e4dfee684fb8e5ed468df71dc95f 2023-07-15 16:11:25,726 INFO [StoreOpener-6216bbc3d263afb15d19f28122124a7c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 6216bbc3d263afb15d19f28122124a7c 2023-07-15 16:11:25,730 DEBUG [StoreOpener-c9b1e4dfee684fb8e5ed468df71dc95f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportFileSystemState/c9b1e4dfee684fb8e5ed468df71dc95f/cf 2023-07-15 16:11:25,730 DEBUG [StoreOpener-c9b1e4dfee684fb8e5ed468df71dc95f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportFileSystemState/c9b1e4dfee684fb8e5ed468df71dc95f/cf 2023-07-15 16:11:25,731 DEBUG [StoreOpener-6216bbc3d263afb15d19f28122124a7c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportFileSystemState/6216bbc3d263afb15d19f28122124a7c/cf 2023-07-15 16:11:25,731 DEBUG [StoreOpener-6216bbc3d263afb15d19f28122124a7c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportFileSystemState/6216bbc3d263afb15d19f28122124a7c/cf 2023-07-15 16:11:25,731 INFO [StoreOpener-c9b1e4dfee684fb8e5ed468df71dc95f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c9b1e4dfee684fb8e5ed468df71dc95f columnFamilyName cf 2023-07-15 16:11:25,731 INFO [StoreOpener-6216bbc3d263afb15d19f28122124a7c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6216bbc3d263afb15d19f28122124a7c columnFamilyName cf 2023-07-15 16:11:25,732 INFO [StoreOpener-c9b1e4dfee684fb8e5ed468df71dc95f-1] regionserver.HStore(310): Store=c9b1e4dfee684fb8e5ed468df71dc95f/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 16:11:25,733 INFO [StoreOpener-6216bbc3d263afb15d19f28122124a7c-1] regionserver.HStore(310): Store=6216bbc3d263afb15d19f28122124a7c/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 16:11:25,735 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportFileSystemState/c9b1e4dfee684fb8e5ed468df71dc95f 2023-07-15 16:11:25,735 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportFileSystemState/6216bbc3d263afb15d19f28122124a7c 2023-07-15 16:11:25,736 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportFileSystemState/c9b1e4dfee684fb8e5ed468df71dc95f 2023-07-15 16:11:25,736 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportFileSystemState/6216bbc3d263afb15d19f28122124a7c 2023-07-15 16:11:25,739 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c9b1e4dfee684fb8e5ed468df71dc95f 2023-07-15 16:11:25,739 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6216bbc3d263afb15d19f28122124a7c 2023-07-15 16:11:25,741 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportFileSystemState/c9b1e4dfee684fb8e5ed468df71dc95f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 16:11:25,742 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportFileSystemState/6216bbc3d263afb15d19f28122124a7c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 16:11:25,742 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c9b1e4dfee684fb8e5ed468df71dc95f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68626710, jitterRate=0.02261766791343689}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 16:11:25,742 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6216bbc3d263afb15d19f28122124a7c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63122411, jitterRate=-0.05940277874469757}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 16:11:25,742 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c9b1e4dfee684fb8e5ed468df71dc95f: 2023-07-15 16:11:25,742 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6216bbc3d263afb15d19f28122124a7c: 2023-07-15 16:11:25,744 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1689437484923.6216bbc3d263afb15d19f28122124a7c., pid=30, masterSystemTime=1689437485713 2023-07-15 16:11:25,744 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1689437484923.c9b1e4dfee684fb8e5ed468df71dc95f., pid=31, masterSystemTime=1689437485714 2023-07-15 16:11:25,753 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1689437484923.6216bbc3d263afb15d19f28122124a7c. 2023-07-15 16:11:25,753 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1689437484923.6216bbc3d263afb15d19f28122124a7c. 2023-07-15 16:11:25,759 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=6216bbc3d263afb15d19f28122124a7c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:25,759 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1689437484923.c9b1e4dfee684fb8e5ed468df71dc95f. 2023-07-15 16:11:25,759 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1689437484923.c9b1e4dfee684fb8e5ed468df71dc95f. 2023-07-15 16:11:25,759 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1689437484923.6216bbc3d263afb15d19f28122124a7c.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689437485759"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689437485759"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689437485759"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689437485759"}]},"ts":"1689437485759"} 2023-07-15 16:11:25,760 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=c9b1e4dfee684fb8e5ed468df71dc95f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:11:25,760 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1689437484923.c9b1e4dfee684fb8e5ed468df71dc95f.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689437485760"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689437485760"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689437485760"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689437485760"}]},"ts":"1689437485760"} 2023-07-15 16:11:25,764 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=28 2023-07-15 16:11:25,766 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=28, state=SUCCESS; OpenRegionProcedure 6216bbc3d263afb15d19f28122124a7c, server=jenkins-hbase4.apache.org,43103,1689437454905 in 200 msec 2023-07-15 16:11:25,767 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=29 2023-07-15 16:11:25,768 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6216bbc3d263afb15d19f28122124a7c, ASSIGN in 365 msec 2023-07-15 16:11:25,769 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=29, state=SUCCESS; OpenRegionProcedure c9b1e4dfee684fb8e5ed468df71dc95f, server=jenkins-hbase4.apache.org,45149,1689437455062 in 201 msec 2023-07-15 16:11:25,771 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=27 2023-07-15 16:11:25,771 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=c9b1e4dfee684fb8e5ed468df71dc95f, ASSIGN in 366 msec 2023-07-15 16:11:25,772 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-15 16:11:25,772 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689437485772"}]},"ts":"1689437485772"} 2023-07-15 16:11:25,773 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-07-15 16:11:25,777 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-15 16:11:25,777 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-07-15 16:11:25,779 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43103] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-15 16:11:25,780 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 16:11:25,781 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 16:11:25,780 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 16:11:25,780 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 16:11:25,782 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-15 16:11:25,782 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-15 16:11:25,782 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-15 16:11:25,782 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-15 16:11:25,784 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 857 msec 2023-07-15 16:11:26,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-15 16:11:26,038 INFO [Listener at jenkins-hbase4.apache.org/42699] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-07-15 16:11:26,038 DEBUG [Listener at jenkins-hbase4.apache.org/42699] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemState get assigned. Timeout = 60000ms 2023-07-15 16:11:26,038 INFO [Listener at jenkins-hbase4.apache.org/42699] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 16:11:26,042 INFO [Listener at jenkins-hbase4.apache.org/42699] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemState assigned to meta. Checking AM states. 2023-07-15 16:11:26,042 INFO [Listener at jenkins-hbase4.apache.org/42699] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 16:11:26,042 INFO [Listener at jenkins-hbase4.apache.org/42699] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemState assigned. 2023-07-15 16:11:26,045 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-15 16:11:26,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689437486045 (current time:1689437486045). 2023-07-15 16:11:26,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 16:11:26,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] zookeeper.ReadOnlyZKClient(139): Connect 0x287cbe8d to 127.0.0.1:58438 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 16:11:26,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6028bbf0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 16:11:26,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 16:11:26,058 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54632, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 16:11:26,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x287cbe8d to 127.0.0.1:58438 2023-07-15 16:11:26,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 16:11:26,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] zookeeper.ReadOnlyZKClient(139): Connect 0x7752a68d to 127.0.0.1:58438 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 16:11:26,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3a17e63c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 16:11:26,065 DEBUG [hconnection-0x1f452db5-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 16:11:26,066 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54638, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 16:11:26,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7752a68d to 127.0.0.1:58438 2023-07-15 16:11:26,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 16:11:26,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-15 16:11:26,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 16:11:26,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-15 16:11:26,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-15 16:11:26,075 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-15 16:11:26,076 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689438086076 2023-07-15 16:11:26,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-15 16:11:26,076 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-15 16:11:26,077 DEBUG [Listener at jenkins-hbase4.apache.org/42699] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 16:11:26,077 DEBUG [Listener at jenkins-hbase4.apache.org/42699] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 16:11:26,078 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-15 16:11:26,078 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-15 16:11:26,080 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 5 msec 2023-07-15 16:11:26,081 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-15 16:11:26,082 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689438086082 2023-07-15 16:11:26,093 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:26,093 INFO [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-07-15 16:11:26,093 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 16:11:26,094 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-07-15 16:11:26,094 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-15 16:11:26,095 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:26,095 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:26,097 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:11:26,097 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:11:26,097 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:11:26,097 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:11:26,097 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:11:26,097 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:11:26,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:11:26,097 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:11:26,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:11:26,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:11:26,098 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:11:26,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:26,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:26,098 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:26,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:26,098 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:26,098 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:26,098 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:26,098 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:26,098 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 16:11:26,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-15 16:11:26,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:26,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-15 16:11:26,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:26,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-15 16:11:26,099 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-15 16:11:26,099 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-15 16:11:26,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:26,099 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-15 16:11:26,099 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:26,099 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:26,099 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-15 16:11:26,099 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-15 16:11:26,099 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:26,099 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 16:11:26,099 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-15 16:11:26,100 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-15 16:11:26,100 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-15 16:11:26,099 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 16:11:26,100 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45149,1689437455062' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-15 16:11:26,100 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 16:11:26,101 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-15 16:11:26,101 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-15 16:11:26,102 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-15 16:11:26,102 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35773,1689437454990' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-15 16:11:26,101 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-15 16:11:26,102 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43103,1689437454905' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-15 16:11:26,103 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:26,103 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:11:26,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:11:26,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:11:26,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:11:26,109 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:26,110 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:26,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:11:26,109 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:26,110 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:26,110 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 16:11:26,110 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:26,110 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 16:11:26,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:11:26,110 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:26,110 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 16:11:26,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:26,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:11:26,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:11:26,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:26,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:11:26,112 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45149,1689437455062' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-15 16:11:26,112 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2d3f1d33[Count = 1] remaining members to acquire global barrier 2023-07-15 16:11:26,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:26,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:11:26,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:11:26,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:11:26,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:11:26,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:26,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:11:26,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:11:26,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:26,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:11:26,121 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43103,1689437454905' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-15 16:11:26,121 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2d3f1d33[Count = 0] remaining members to acquire global barrier 2023-07-15 16:11:26,121 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-15 16:11:26,121 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:26,123 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:26,123 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:26,123 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:26,123 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:26,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:26,123 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:26,123 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:11:26,123 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:26,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:26,123 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-15 16:11:26,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:26,123 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-15 16:11:26,123 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-15 16:11:26,123 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:26,123 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 16:11:26,123 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-15 16:11:26,124 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35773,1689437454990' in zk 2023-07-15 16:11:26,125 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-15 16:11:26,125 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 16:11:26,125 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-15 16:11:26,131 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 16:11:26,131 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 16:11:26,131 DEBUG [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689437484923.6216bbc3d263afb15d19f28122124a7c. 2023-07-15 16:11:26,131 DEBUG [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689437484923.6216bbc3d263afb15d19f28122124a7c. started... 2023-07-15 16:11:26,133 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 16:11:26,134 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 16:11:26,134 DEBUG [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6216bbc3d263afb15d19f28122124a7c: 2023-07-15 16:11:26,134 DEBUG [rs(jenkins-hbase4.apache.org,45149,1689437455062)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689437484923.c9b1e4dfee684fb8e5ed468df71dc95f. 2023-07-15 16:11:26,134 DEBUG [rs(jenkins-hbase4.apache.org,45149,1689437455062)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689437484923.c9b1e4dfee684fb8e5ed468df71dc95f. started... 2023-07-15 16:11:26,134 DEBUG [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689437484923.6216bbc3d263afb15d19f28122124a7c.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:26,135 DEBUG [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 16:11:26,135 DEBUG [rs(jenkins-hbase4.apache.org,45149,1689437455062)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c9b1e4dfee684fb8e5ed468df71dc95f: 2023-07-15 16:11:26,136 DEBUG [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-15 16:11:26,136 DEBUG [rs(jenkins-hbase4.apache.org,45149,1689437455062)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689437484923.c9b1e4dfee684fb8e5ed468df71dc95f.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:26,136 DEBUG [rs(jenkins-hbase4.apache.org,45149,1689437455062)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 16:11:26,136 DEBUG [rs(jenkins-hbase4.apache.org,45149,1689437455062)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-15 16:11:26,165 DEBUG [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689437484923.6216bbc3d263afb15d19f28122124a7c. completed. 2023-07-15 16:11:26,166 DEBUG [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689437484923.6216bbc3d263afb15d19f28122124a7c. 2023-07-15 16:11:26,166 DEBUG [rs(jenkins-hbase4.apache.org,45149,1689437455062)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689437484923.c9b1e4dfee684fb8e5ed468df71dc95f. completed. 2023-07-15 16:11:26,166 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 16:11:26,166 DEBUG [rs(jenkins-hbase4.apache.org,45149,1689437455062)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689437484923.c9b1e4dfee684fb8e5ed468df71dc95f. 2023-07-15 16:11:26,166 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 16:11:26,166 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 16:11:26,166 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 16:11:26,166 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:11:26,166 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:26,166 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-15 16:11:26,166 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-15 16:11:26,166 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45149,1689437455062' in zk 2023-07-15 16:11:26,166 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43103,1689437454905' in zk 2023-07-15 16:11:26,168 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-15 16:11:26,168 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 16:11:26,168 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-15 16:11:26,168 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:11:26,169 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 16:11:26,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:11:26,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:11:26,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:11:26,168 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-15 16:11:26,169 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-15 16:11:26,169 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:26,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:11:26,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:11:26,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:26,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:11:26,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:11:26,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:26,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:11:26,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:26,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:11:26,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:11:26,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:26,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,45149,1689437455062': 2023-07-15 16:11:26,174 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45149,1689437455062' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-15 16:11:26,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:26,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:11:26,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:11:26,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:11:26,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:11:26,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:26,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:11:26,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:11:26,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:26,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:11:26,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:26,177 DEBUG [Listener at jenkins-hbase4.apache.org/42699] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 16:11:26,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:11:26,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:11:26,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:26,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-15 16:11:26,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-15 16:11:26,178 DEBUG [Listener at jenkins-hbase4.apache.org/42699] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 16:11:26,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,43103,1689437454905': 2023-07-15 16:11:26,179 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43103,1689437454905' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-15 16:11:26,179 INFO [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-07-15 16:11:26,179 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 16:11:26,179 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 16:11:26,179 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:26,179 INFO [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 16:11:26,182 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:26,182 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:26,182 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:26,182 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:26,182 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:26,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:26,182 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:11:26,182 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:11:26,182 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:26,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:11:26,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:11:26,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:26,182 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:26,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:26,182 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:11:26,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:26,183 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:11:26,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:11:26,184 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:11:26,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:11:26,184 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:11:26,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:11:26,184 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:11:26,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:26,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:11:26,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:26,184 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:11:26,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:26,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:26,185 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:26,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:11:26,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:26,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:11:26,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:11:26,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:26,187 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:11:26,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:11:26,187 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:11:26,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:26,187 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:26,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:11:26,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:11:26,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:26,191 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:11:26,191 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:26,191 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:11:26,191 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:26,191 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:11:26,191 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:11:26,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:11:26,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:11:26,191 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 16:11:26,191 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:11:26,191 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:11:26,193 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:11:26,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:11:26,191 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:11:26,193 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:11:26,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:11:26,193 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:11:26,191 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:26,191 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:11:26,193 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:26,193 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:11:26,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:11:26,193 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:11:26,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:11:26,193 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:11:26,193 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:26,193 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:26,193 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:26,193 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:11:26,193 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:11:26,193 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:26,194 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:26,194 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:26,213 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:26,249 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-15 16:11:26,249 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:26,250 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:26,250 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689437486076Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1689437486193 (+117 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1689437486193Writing data manifest for emptySnaptb0-testExportFileSystemState at 1689437486197 (+4 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1689437486206 (+9 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689437486249 (+43 ms) 2023-07-15 16:11:26,252 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-15 16:11:26,254 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 175 msec 2023-07-15 16:11:26,379 DEBUG [Listener at jenkins-hbase4.apache.org/42699] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 16:11:26,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-15 16:11:26,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 16:11:26,391 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43103] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1689437484923.6216bbc3d263afb15d19f28122124a7c. with WAL disabled. Data may be lost in the event of a crash. 2023-07-15 16:11:26,392 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45149] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1689437484923.c9b1e4dfee684fb8e5ed468df71dc95f. with WAL disabled. Data may be lost in the event of a crash. 2023-07-15 16:11:26,397 DEBUG [Listener at jenkins-hbase4.apache.org/42699] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-15 16:11:26,397 DEBUG [Listener at jenkins-hbase4.apache.org/42699] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689437484923.6216bbc3d263afb15d19f28122124a7c. 2023-07-15 16:11:26,398 INFO [Listener at jenkins-hbase4.apache.org/42699] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 16:11:26,411 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-15 16:11:26,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689437486411 (current time:1689437486411). 2023-07-15 16:11:26,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 16:11:26,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] zookeeper.ReadOnlyZKClient(139): Connect 0x75d2a58f to 127.0.0.1:58438 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 16:11:26,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@de68b26, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 16:11:26,419 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 16:11:26,422 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54652, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 16:11:26,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x75d2a58f to 127.0.0.1:58438 2023-07-15 16:11:26,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 16:11:26,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] zookeeper.ReadOnlyZKClient(139): Connect 0x111ef833 to 127.0.0.1:58438 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 16:11:26,432 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4806d3ef, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 16:11:26,433 DEBUG [hconnection-0x42dbd138-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 16:11:26,436 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54658, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 16:11:26,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x111ef833 to 127.0.0.1:58438 2023-07-15 16:11:26,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 16:11:26,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-15 16:11:26,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 16:11:26,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-15 16:11:26,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-15 16:11:26,445 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-15 16:11:26,446 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689438086446 2023-07-15 16:11:26,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-15 16:11:26,446 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-15 16:11:26,447 DEBUG [Listener at jenkins-hbase4.apache.org/42699] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 16:11:26,447 DEBUG [Listener at jenkins-hbase4.apache.org/42699] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 16:11:26,448 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-15 16:11:26,448 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-15 16:11:26,450 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 5 msec 2023-07-15 16:11:26,451 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-15 16:11:26,452 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689438086452 2023-07-15 16:11:26,463 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-07-15 16:11:26,463 INFO [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-07-15 16:11:26,463 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 16:11:26,465 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-07-15 16:11:26,465 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-15 16:11:26,465 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 16:11:26,465 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-15 16:11:26,466 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:11:26,467 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:11:26,467 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:11:26,467 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:11:26,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:11:26,467 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:11:26,467 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:11:26,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:11:26,467 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:11:26,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:11:26,467 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:11:26,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-15 16:11:26,467 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:26,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-15 16:11:26,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-15 16:11:26,468 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 16:11:26,468 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:26,468 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 16:11:26,468 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 16:11:26,468 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 16:11:26,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-15 16:11:26,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-15 16:11:26,468 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-15 16:11:26,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-15 16:11:26,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-15 16:11:26,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-15 16:11:26,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-15 16:11:26,468 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-15 16:11:26,468 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-15 16:11:26,469 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-15 16:11:26,469 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-15 16:11:26,469 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 16:11:26,470 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-15 16:11:26,472 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-15 16:11:26,472 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-15 16:11:26,472 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-15 16:11:26,472 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-15 16:11:26,472 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 16:11:26,472 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-15 16:11:26,472 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35773,1689437454990' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-15 16:11:26,474 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-15 16:11:26,474 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-15 16:11:26,472 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 16:11:26,474 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45149,1689437455062' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-15 16:11:26,475 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-15 16:11:26,475 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-15 16:11:26,475 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43103,1689437454905' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-15 16:11:26,476 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 16:11:26,478 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 16:11:26,478 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:11:26,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:11:26,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:11:26,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:11:26,478 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:26,478 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 16:11:26,478 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 16:11:26,478 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 16:11:26,478 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 16:11:26,478 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 16:11:26,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:11:26,479 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 16:11:26,479 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 16:11:26,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:11:26,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-15 16:11:26,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:11:26,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:11:26,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:26,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:11:26,481 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45149,1689437455062' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-15 16:11:26,481 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@66b304c1[Count = 1] remaining members to acquire global barrier 2023-07-15 16:11:26,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:26,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:11:26,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:11:26,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:11:26,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:11:26,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-15 16:11:26,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:11:26,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:11:26,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:26,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:11:26,483 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43103,1689437454905' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-15 16:11:26,483 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@66b304c1[Count = 0] remaining members to acquire global barrier 2023-07-15 16:11:26,483 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-15 16:11:26,484 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 16:11:26,485 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 16:11:26,485 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 16:11:26,485 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 16:11:26,485 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 16:11:26,485 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 16:11:26,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 16:11:26,485 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 16:11:26,486 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-15 16:11:26,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 16:11:26,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 16:11:26,486 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:11:26,486 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-15 16:11:26,486 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-15 16:11:26,486 DEBUG [rs(jenkins-hbase4.apache.org,45149,1689437455062)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689437484923.c9b1e4dfee684fb8e5ed468df71dc95f. 2023-07-15 16:11:26,486 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-15 16:11:26,486 DEBUG [rs(jenkins-hbase4.apache.org,45149,1689437455062)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689437484923.c9b1e4dfee684fb8e5ed468df71dc95f. started... 2023-07-15 16:11:26,486 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 16:11:26,486 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 16:11:26,486 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35773,1689437454990' in zk 2023-07-15 16:11:26,486 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:26,487 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 16:11:26,487 INFO [rs(jenkins-hbase4.apache.org,45149,1689437455062)-snapshot-pool-0] regionserver.HRegion(2745): Flushing c9b1e4dfee684fb8e5ed468df71dc95f 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-07-15 16:11:26,487 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 16:11:26,487 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 16:11:26,487 DEBUG [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689437484923.6216bbc3d263afb15d19f28122124a7c. 2023-07-15 16:11:26,487 DEBUG [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689437484923.6216bbc3d263afb15d19f28122124a7c. started... 2023-07-15 16:11:26,487 INFO [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 6216bbc3d263afb15d19f28122124a7c 1/1 column families, dataSize=333 B heapSize=976 B 2023-07-15 16:11:26,488 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-15 16:11:26,489 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 16:11:26,489 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-15 16:11:26,523 INFO [rs(jenkins-hbase4.apache.org,45149,1689437455062)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.93 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportFileSystemState/c9b1e4dfee684fb8e5ed468df71dc95f/.tmp/cf/ddf785c782bb49d59b447d537b658c9e 2023-07-15 16:11:26,527 INFO [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=333 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportFileSystemState/6216bbc3d263afb15d19f28122124a7c/.tmp/cf/a8a2540629cb4cb8bc4843e38de81cba 2023-07-15 16:11:26,541 DEBUG [rs(jenkins-hbase4.apache.org,45149,1689437455062)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportFileSystemState/c9b1e4dfee684fb8e5ed468df71dc95f/.tmp/cf/ddf785c782bb49d59b447d537b658c9e as hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportFileSystemState/c9b1e4dfee684fb8e5ed468df71dc95f/cf/ddf785c782bb49d59b447d537b658c9e 2023-07-15 16:11:26,547 DEBUG [Listener at jenkins-hbase4.apache.org/42699] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 16:11:26,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-15 16:11:26,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-15 16:11:26,551 DEBUG [Listener at jenkins-hbase4.apache.org/42699] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 16:11:26,553 DEBUG [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportFileSystemState/6216bbc3d263afb15d19f28122124a7c/.tmp/cf/a8a2540629cb4cb8bc4843e38de81cba as hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportFileSystemState/6216bbc3d263afb15d19f28122124a7c/cf/a8a2540629cb4cb8bc4843e38de81cba 2023-07-15 16:11:26,556 INFO [rs(jenkins-hbase4.apache.org,45149,1689437455062)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportFileSystemState/c9b1e4dfee684fb8e5ed468df71dc95f/cf/ddf785c782bb49d59b447d537b658c9e, entries=45, sequenceid=6, filesize=7.9 K 2023-07-15 16:11:26,558 INFO [rs(jenkins-hbase4.apache.org,45149,1689437455062)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for c9b1e4dfee684fb8e5ed468df71dc95f in 72ms, sequenceid=6, compaction requested=false 2023-07-15 16:11:26,558 DEBUG [rs(jenkins-hbase4.apache.org,45149,1689437455062)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-15 16:11:26,559 DEBUG [rs(jenkins-hbase4.apache.org,45149,1689437455062)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c9b1e4dfee684fb8e5ed468df71dc95f: 2023-07-15 16:11:26,559 DEBUG [rs(jenkins-hbase4.apache.org,45149,1689437455062)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689437484923.c9b1e4dfee684fb8e5ed468df71dc95f.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-15 16:11:26,559 DEBUG [rs(jenkins-hbase4.apache.org,45149,1689437455062)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 16:11:26,559 DEBUG [rs(jenkins-hbase4.apache.org,45149,1689437455062)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportFileSystemState/c9b1e4dfee684fb8e5ed468df71dc95f/cf/ddf785c782bb49d59b447d537b658c9e] hfiles 2023-07-15 16:11:26,559 DEBUG [rs(jenkins-hbase4.apache.org,45149,1689437455062)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportFileSystemState/c9b1e4dfee684fb8e5ed468df71dc95f/cf/ddf785c782bb49d59b447d537b658c9e for snapshot=snaptb0-testExportFileSystemState 2023-07-15 16:11:26,560 INFO [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportFileSystemState/6216bbc3d263afb15d19f28122124a7c/cf/a8a2540629cb4cb8bc4843e38de81cba, entries=5, sequenceid=6, filesize=5.2 K 2023-07-15 16:11:26,562 INFO [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 6216bbc3d263afb15d19f28122124a7c in 75ms, sequenceid=6, compaction requested=false 2023-07-15 16:11:26,564 DEBUG [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6216bbc3d263afb15d19f28122124a7c: 2023-07-15 16:11:26,564 DEBUG [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689437484923.6216bbc3d263afb15d19f28122124a7c.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-15 16:11:26,564 DEBUG [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 16:11:26,564 DEBUG [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportFileSystemState/6216bbc3d263afb15d19f28122124a7c/cf/a8a2540629cb4cb8bc4843e38de81cba] hfiles 2023-07-15 16:11:26,564 DEBUG [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportFileSystemState/6216bbc3d263afb15d19f28122124a7c/cf/a8a2540629cb4cb8bc4843e38de81cba for snapshot=snaptb0-testExportFileSystemState 2023-07-15 16:11:26,604 DEBUG [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689437484923.6216bbc3d263afb15d19f28122124a7c. completed. 2023-07-15 16:11:26,604 DEBUG [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689437484923.6216bbc3d263afb15d19f28122124a7c. 2023-07-15 16:11:26,604 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 16:11:26,604 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 16:11:26,605 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:26,605 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-15 16:11:26,605 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43103,1689437454905' in zk 2023-07-15 16:11:26,610 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-15 16:11:26,611 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:26,611 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 16:11:26,611 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-15 16:11:26,617 DEBUG [rs(jenkins-hbase4.apache.org,45149,1689437455062)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689437484923.c9b1e4dfee684fb8e5ed468df71dc95f. completed. 2023-07-15 16:11:26,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:26,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:11:26,619 DEBUG [rs(jenkins-hbase4.apache.org,45149,1689437455062)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689437484923.c9b1e4dfee684fb8e5ed468df71dc95f. 2023-07-15 16:11:26,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:11:26,619 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 16:11:26,619 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 16:11:26,619 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:11:26,619 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-15 16:11:26,620 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45149,1689437455062' in zk 2023-07-15 16:11:26,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:11:26,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:11:26,621 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-15 16:11:26,621 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 16:11:26,621 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-15 16:11:26,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-15 16:11:26,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:11:26,625 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:11:26,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:11:26,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:26,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:11:26,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-15 16:11:26,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:11:26,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:11:26,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:26,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,43103,1689437454905': 2023-07-15 16:11:26,629 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43103,1689437454905' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-15 16:11:26,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:11:26,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:11:26,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:11:26,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:11:26,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:11:26,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-15 16:11:26,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:11:26,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:11:26,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:26,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:11:26,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-15 16:11:26,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:11:26,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:11:26,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:26,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,45149,1689437455062': 2023-07-15 16:11:26,634 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45149,1689437455062' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-15 16:11:26,634 INFO [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-07-15 16:11:26,634 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 16:11:26,634 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 16:11:26,635 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-07-15 16:11:26,635 INFO [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 16:11:26,637 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 16:11:26,637 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 16:11:26,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 16:11:26,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:11:26,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:11:26,637 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 16:11:26,637 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:11:26,637 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 16:11:26,637 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 16:11:26,637 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 16:11:26,637 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 16:11:26,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 16:11:26,637 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:11:26,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 16:11:26,638 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:11:26,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:11:26,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 16:11:26,637 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:11:26,638 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:11:26,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:11:26,638 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:11:26,638 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:11:26,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:11:26,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-15 16:11:26,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 16:11:26,638 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:11:26,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:11:26,638 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:26,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 16:11:26,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:11:26,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 16:11:26,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-15 16:11:26,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:11:26,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:11:26,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:26,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:11:26,641 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:11:26,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-15 16:11:26,641 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:11:26,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:11:26,642 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:26,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:11:26,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:26,645 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:26,645 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-15 16:11:26,645 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:11:26,645 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:11:26,645 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-15 16:11:26,645 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:26,645 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:11:26,645 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 16:11:26,645 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:11:26,645 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:11:26,645 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:11:26,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:11:26,645 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:11:26,645 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:11:26,645 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 16:11:26,645 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:11:26,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:11:26,646 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 16:11:26,645 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 16:11:26,645 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:11:26,646 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:11:26,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:11:26,646 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-07-15 16:11:26,646 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:11:26,647 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:11:26,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:11:26,647 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-07-15 16:11:26,647 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:11:26,647 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:11:26,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:11:26,648 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:11:26,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:11:26,648 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-15 16:11:26,672 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-15 16:11:26,698 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-15 16:11:26,699 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-15 16:11:26,699 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-15 16:11:26,699 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689437486446Consolidate snapshot: snaptb0-testExportFileSystemState at 1689437486647 (+201 ms)Loading Region manifests for snaptb0-testExportFileSystemState at 1689437486648 (+1 ms)Writing data manifest for snaptb0-testExportFileSystemState at 1689437486651 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1689437486664 (+13 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689437486698 (+34 ms) 2023-07-15 16:11:26,702 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-15 16:11:26,704 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 255 msec 2023-07-15 16:11:26,751 DEBUG [Listener at jenkins-hbase4.apache.org/42699] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 16:11:26,756 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-15 16:11:26,756 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 16:11:26,756 INFO [Listener at jenkins-hbase4.apache.org/42699] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/export-test/export-1689437486756 2023-07-15 16:11:26,756 INFO [Listener at jenkins-hbase4.apache.org/42699] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:44749, tgtDir=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/export-test/export-1689437486756, rawTgtDir=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/export-test/export-1689437486756, srcFsUri=hdfs://localhost:44749, srcDir=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8 2023-07-15 16:11:26,786 DEBUG [Listener at jenkins-hbase4.apache.org/42699] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44749, inputRoot=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8 2023-07-15 16:11:26,786 DEBUG [Listener at jenkins-hbase4.apache.org/42699] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-842259839_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/export-test/export-1689437486756, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/export-test/export-1689437486756/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-15 16:11:26,787 INFO [Listener at jenkins-hbase4.apache.org/42699] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44749, inputRoot=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8, snapshotDir=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-07-15 16:11:26,803 INFO [Listener at jenkins-hbase4.apache.org/42699] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/export-test/export-1689437486756/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-15 16:11:26,831 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-15 16:11:26,831 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-15 16:11:26,832 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-15 16:11:26,832 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-15 16:11:27,827 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1587f29c-5daf-234a-1773-5088522b715e/hadoop-784296353380224117.jar 2023-07-15 16:11:27,827 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-15 16:11:27,828 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-15 16:11:27,895 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1587f29c-5daf-234a-1773-5088522b715e/hadoop-5786716373012668188.jar 2023-07-15 16:11:27,895 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-15 16:11:27,895 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-15 16:11:27,896 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-15 16:11:27,896 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-15 16:11:27,897 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-15 16:11:27,897 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-15 16:11:27,897 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-15 16:11:27,898 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-15 16:11:27,898 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-15 16:11:27,899 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-15 16:11:27,899 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-15 16:11:27,899 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-15 16:11:27,900 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-15 16:11:27,900 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-15 16:11:27,900 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-15 16:11:27,901 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-15 16:11:27,902 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 16:11:27,902 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 16:11:27,903 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 16:11:27,903 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 16:11:27,903 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 16:11:27,904 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 16:11:27,904 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 16:11:28,415 WARN [Listener at jenkins-hbase4.apache.org/42699] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-15 16:11:28,418 INFO [Listener at jenkins-hbase4.apache.org/42699] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-07-15 16:11:28,420 DEBUG [Listener at jenkins-hbase4.apache.org/42699] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-15 16:11:28,748 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 16:11:28,748 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 16:11:28,754 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689437464006_0001_000001 (auth:SIMPLE) 2023-07-15 16:11:29,546 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689437464006_0002_000001 (auth:SIMPLE) 2023-07-15 16:11:30,223 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-15 16:11:34,760 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689437464006_0002_000001 (auth:SIMPLE) 2023-07-15 16:11:36,994 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689437464006_0002_000001 (auth:SIMPLE) 2023-07-15 16:11:41,622 INFO [Listener at jenkins-hbase4.apache.org/42699] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-15 16:11:41,625 INFO [Listener at jenkins-hbase4.apache.org/42699] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-15 16:11:41,633 INFO [Listener at jenkins-hbase4.apache.org/42699] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-07-15 16:11:41,633 INFO [Listener at jenkins-hbase4.apache.org/42699] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-15 16:11:41,634 INFO [Listener at jenkins-hbase4.apache.org/42699] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-15 16:11:41,634 DEBUG [Listener at jenkins-hbase4.apache.org/42699] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-127961896_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-15 16:11:41,635 DEBUG [Listener at jenkins-hbase4.apache.org/42699] snapshot.TestExportSnapshot(367): hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-15 16:11:41,635 DEBUG [Listener at jenkins-hbase4.apache.org/42699] snapshot.TestExportSnapshot(367): hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-15 16:11:41,635 DEBUG [Listener at jenkins-hbase4.apache.org/42699] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-127961896_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/export-test/export-1689437486756/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/export-test/export-1689437486756/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-15 16:11:41,635 DEBUG [Listener at jenkins-hbase4.apache.org/42699] snapshot.TestExportSnapshot(367): hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/export-test/export-1689437486756/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-15 16:11:41,635 DEBUG [Listener at jenkins-hbase4.apache.org/42699] snapshot.TestExportSnapshot(367): hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/export-test/export-1689437486756/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-15 16:11:41,642 INFO [Listener at jenkins-hbase4.apache.org/42699] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-07-15 16:11:41,642 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-07-15 16:11:41,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] procedure2.ProcedureExecutor(1029): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-07-15 16:11:41,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-15 16:11:41,648 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689437501647"}]},"ts":"1689437501647"} 2023-07-15 16:11:41,649 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-07-15 16:11:41,651 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-07-15 16:11:41,652 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6216bbc3d263afb15d19f28122124a7c, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=c9b1e4dfee684fb8e5ed468df71dc95f, UNASSIGN}] 2023-07-15 16:11:41,654 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6216bbc3d263afb15d19f28122124a7c, UNASSIGN 2023-07-15 16:11:41,655 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=c9b1e4dfee684fb8e5ed468df71dc95f, UNASSIGN 2023-07-15 16:11:41,655 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=6216bbc3d263afb15d19f28122124a7c, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:41,655 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=c9b1e4dfee684fb8e5ed468df71dc95f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:11:41,656 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689437484923.c9b1e4dfee684fb8e5ed468df71dc95f.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689437501655"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689437501655"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689437501655"}]},"ts":"1689437501655"} 2023-07-15 16:11:41,656 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689437484923.6216bbc3d263afb15d19f28122124a7c.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689437501655"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689437501655"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689437501655"}]},"ts":"1689437501655"} 2023-07-15 16:11:41,657 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=38, state=RUNNABLE; CloseRegionProcedure c9b1e4dfee684fb8e5ed468df71dc95f, server=jenkins-hbase4.apache.org,45149,1689437455062}] 2023-07-15 16:11:41,658 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=37, state=RUNNABLE; CloseRegionProcedure 6216bbc3d263afb15d19f28122124a7c, server=jenkins-hbase4.apache.org,43103,1689437454905}] 2023-07-15 16:11:41,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-15 16:11:41,810 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close c9b1e4dfee684fb8e5ed468df71dc95f 2023-07-15 16:11:41,810 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c9b1e4dfee684fb8e5ed468df71dc95f, disabling compactions & flushes 2023-07-15 16:11:41,810 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689437484923.c9b1e4dfee684fb8e5ed468df71dc95f. 2023-07-15 16:11:41,810 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689437484923.c9b1e4dfee684fb8e5ed468df71dc95f. 2023-07-15 16:11:41,810 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689437484923.c9b1e4dfee684fb8e5ed468df71dc95f. after waiting 0 ms 2023-07-15 16:11:41,810 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689437484923.c9b1e4dfee684fb8e5ed468df71dc95f. 2023-07-15 16:11:41,814 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 6216bbc3d263afb15d19f28122124a7c 2023-07-15 16:11:41,815 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6216bbc3d263afb15d19f28122124a7c, disabling compactions & flushes 2023-07-15 16:11:41,815 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689437484923.6216bbc3d263afb15d19f28122124a7c. 2023-07-15 16:11:41,815 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689437484923.6216bbc3d263afb15d19f28122124a7c. 2023-07-15 16:11:41,815 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689437484923.6216bbc3d263afb15d19f28122124a7c. after waiting 0 ms 2023-07-15 16:11:41,815 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689437484923.6216bbc3d263afb15d19f28122124a7c. 2023-07-15 16:11:41,830 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportFileSystemState/c9b1e4dfee684fb8e5ed468df71dc95f/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 16:11:41,830 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportFileSystemState/6216bbc3d263afb15d19f28122124a7c/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 16:11:41,831 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 16:11:41,831 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 16:11:41,832 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689437484923.6216bbc3d263afb15d19f28122124a7c. 2023-07-15 16:11:41,832 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689437484923.c9b1e4dfee684fb8e5ed468df71dc95f. 2023-07-15 16:11:41,832 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6216bbc3d263afb15d19f28122124a7c: 2023-07-15 16:11:41,832 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c9b1e4dfee684fb8e5ed468df71dc95f: 2023-07-15 16:11:41,834 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed c9b1e4dfee684fb8e5ed468df71dc95f 2023-07-15 16:11:41,836 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=c9b1e4dfee684fb8e5ed468df71dc95f, regionState=CLOSED 2023-07-15 16:11:41,836 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689437484923.c9b1e4dfee684fb8e5ed468df71dc95f.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689437501836"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689437501836"}]},"ts":"1689437501836"} 2023-07-15 16:11:41,836 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 6216bbc3d263afb15d19f28122124a7c 2023-07-15 16:11:41,837 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=6216bbc3d263afb15d19f28122124a7c, regionState=CLOSED 2023-07-15 16:11:41,837 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689437484923.6216bbc3d263afb15d19f28122124a7c.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689437501837"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689437501837"}]},"ts":"1689437501837"} 2023-07-15 16:11:41,844 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=38 2023-07-15 16:11:41,844 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=38, state=SUCCESS; CloseRegionProcedure c9b1e4dfee684fb8e5ed468df71dc95f, server=jenkins-hbase4.apache.org,45149,1689437455062 in 184 msec 2023-07-15 16:11:41,845 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=37 2023-07-15 16:11:41,845 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=37, state=SUCCESS; CloseRegionProcedure 6216bbc3d263afb15d19f28122124a7c, server=jenkins-hbase4.apache.org,43103,1689437454905 in 183 msec 2023-07-15 16:11:41,845 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=c9b1e4dfee684fb8e5ed468df71dc95f, UNASSIGN in 192 msec 2023-07-15 16:11:41,847 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=37, resume processing ppid=36 2023-07-15 16:11:41,847 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6216bbc3d263afb15d19f28122124a7c, UNASSIGN in 193 msec 2023-07-15 16:11:41,848 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689437501848"}]},"ts":"1689437501848"} 2023-07-15 16:11:41,850 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-07-15 16:11:41,853 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-07-15 16:11:41,859 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 216 msec 2023-07-15 16:11:41,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-15 16:11:41,950 INFO [Listener at jenkins-hbase4.apache.org/42699] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-07-15 16:11:41,951 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-07-15 16:11:41,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] procedure2.ProcedureExecutor(1029): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-15 16:11:41,955 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-15 16:11:41,955 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-07-15 16:11:41,957 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-15 16:11:41,957 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43103] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-07-15 16:11:41,961 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-15 16:11:41,961 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-15 16:11:41,961 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-15 16:11:41,961 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-15 16:11:41,961 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-15 16:11:41,962 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-15 16:11:41,963 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-15 16:11:41,963 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 16:11:41,963 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-15 16:11:41,963 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 16:11:41,963 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data null 2023-07-15 16:11:41,963 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-15 16:11:41,963 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 16:11:41,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-15 16:11:41,964 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data null 2023-07-15 16:11:41,964 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-15 16:11:41,964 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 16:11:41,965 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testExportFileSystemState/6216bbc3d263afb15d19f28122124a7c 2023-07-15 16:11:41,967 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testExportFileSystemState/6216bbc3d263afb15d19f28122124a7c/cf, FileablePath, hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testExportFileSystemState/6216bbc3d263afb15d19f28122124a7c/recovered.edits] 2023-07-15 16:11:41,974 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testExportFileSystemState/c9b1e4dfee684fb8e5ed468df71dc95f 2023-07-15 16:11:41,974 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testExportFileSystemState/6216bbc3d263afb15d19f28122124a7c/cf/a8a2540629cb4cb8bc4843e38de81cba to hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/archive/data/default/testtb-testExportFileSystemState/6216bbc3d263afb15d19f28122124a7c/cf/a8a2540629cb4cb8bc4843e38de81cba 2023-07-15 16:11:41,979 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testExportFileSystemState/c9b1e4dfee684fb8e5ed468df71dc95f/cf, FileablePath, hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testExportFileSystemState/c9b1e4dfee684fb8e5ed468df71dc95f/recovered.edits] 2023-07-15 16:11:41,981 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testExportFileSystemState/6216bbc3d263afb15d19f28122124a7c/recovered.edits/9.seqid to hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/archive/data/default/testtb-testExportFileSystemState/6216bbc3d263afb15d19f28122124a7c/recovered.edits/9.seqid 2023-07-15 16:11:41,982 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testExportFileSystemState/6216bbc3d263afb15d19f28122124a7c 2023-07-15 16:11:41,984 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testExportFileSystemState/c9b1e4dfee684fb8e5ed468df71dc95f/cf/ddf785c782bb49d59b447d537b658c9e to hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/archive/data/default/testtb-testExportFileSystemState/c9b1e4dfee684fb8e5ed468df71dc95f/cf/ddf785c782bb49d59b447d537b658c9e 2023-07-15 16:11:41,988 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testExportFileSystemState/c9b1e4dfee684fb8e5ed468df71dc95f/recovered.edits/9.seqid to hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/archive/data/default/testtb-testExportFileSystemState/c9b1e4dfee684fb8e5ed468df71dc95f/recovered.edits/9.seqid 2023-07-15 16:11:41,988 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testExportFileSystemState/c9b1e4dfee684fb8e5ed468df71dc95f 2023-07-15 16:11:41,988 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-15 16:11:41,991 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-15 16:11:41,995 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-07-15 16:11:41,997 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-07-15 16:11:41,999 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-15 16:11:41,999 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-07-15 16:11:41,999 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1689437484923.6216bbc3d263afb15d19f28122124a7c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689437501999"}]},"ts":"9223372036854775807"} 2023-07-15 16:11:41,999 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1689437484923.c9b1e4dfee684fb8e5ed468df71dc95f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689437501999"}]},"ts":"9223372036854775807"} 2023-07-15 16:11:42,004 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-15 16:11:42,004 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 6216bbc3d263afb15d19f28122124a7c, NAME => 'testtb-testExportFileSystemState,,1689437484923.6216bbc3d263afb15d19f28122124a7c.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => c9b1e4dfee684fb8e5ed468df71dc95f, NAME => 'testtb-testExportFileSystemState,1,1689437484923.c9b1e4dfee684fb8e5ed468df71dc95f.', STARTKEY => '1', ENDKEY => ''}] 2023-07-15 16:11:42,004 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-07-15 16:11:42,004 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689437502004"}]},"ts":"9223372036854775807"} 2023-07-15 16:11:42,006 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-07-15 16:11:42,009 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-15 16:11:42,011 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 58 msec 2023-07-15 16:11:42,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-15 16:11:42,066 INFO [Listener at jenkins-hbase4.apache.org/42699] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-07-15 16:11:42,082 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-07-15 16:11:42,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:42,086 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-07-15 16:11:42,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-07-15 16:11:42,116 INFO [Listener at jenkins-hbase4.apache.org/42699] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemState Thread=761 (was 753) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-127961896_17 at /127.0.0.1:47654 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-2067 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x606da78-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-252812469_1 at /127.0.0.1:46036 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-127961896_17 at /127.0.0.1:41496 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x606da78-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-127961896_17 at /127.0.0.1:59250 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1012686161) connection to jenkins-hbase4.apache.org/172.31.14.131:39491 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-252812469_1 at /127.0.0.1:33750 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x606da78-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x606da78-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=910 (was 925), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=409 (was 449), ProcessCount=183 (was 183), AvailableMemoryMB=3006 (was 3139) 2023-07-15 16:11:42,117 WARN [Listener at jenkins-hbase4.apache.org/42699] hbase.ResourceChecker(130): Thread=761 is superior to 500 2023-07-15 16:11:42,140 INFO [Listener at jenkins-hbase4.apache.org/42699] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testConsecutiveExports Thread=761, OpenFileDescriptor=910, MaxFileDescriptor=60000, SystemLoadAverage=409, ProcessCount=183, AvailableMemoryMB=3006 2023-07-15 16:11:42,140 WARN [Listener at jenkins-hbase4.apache.org/42699] hbase.ResourceChecker(130): Thread=761 is superior to 500 2023-07-15 16:11:42,143 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-15 16:11:42,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-07-15 16:11:42,147 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-07-15 16:11:42,147 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-07-15 16:11:42,148 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-15 16:11:42,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-15 16:11:42,151 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testConsecutiveExports/909bb1560d27e98b016e0a15f2e6e5ff 2023-07-15 16:11:42,151 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testConsecutiveExports/72eac9e91762db39c5e36d093362e297 2023-07-15 16:11:42,152 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testConsecutiveExports/909bb1560d27e98b016e0a15f2e6e5ff empty. 2023-07-15 16:11:42,152 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testConsecutiveExports/72eac9e91762db39c5e36d093362e297 empty. 2023-07-15 16:11:42,153 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testConsecutiveExports/72eac9e91762db39c5e36d093362e297 2023-07-15 16:11:42,153 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testConsecutiveExports/909bb1560d27e98b016e0a15f2e6e5ff 2023-07-15 16:11:42,153 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-15 16:11:42,177 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-07-15 16:11:42,178 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => 909bb1560d27e98b016e0a15f2e6e5ff, NAME => 'testtb-testConsecutiveExports,,1689437502142.909bb1560d27e98b016e0a15f2e6e5ff.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp 2023-07-15 16:11:42,179 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => 72eac9e91762db39c5e36d093362e297, NAME => 'testtb-testConsecutiveExports,1,1689437502142.72eac9e91762db39c5e36d093362e297.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp 2023-07-15 16:11:42,235 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689437502142.72eac9e91762db39c5e36d093362e297.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 16:11:42,235 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing 72eac9e91762db39c5e36d093362e297, disabling compactions & flushes 2023-07-15 16:11:42,235 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689437502142.72eac9e91762db39c5e36d093362e297. 2023-07-15 16:11:42,235 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689437502142.72eac9e91762db39c5e36d093362e297. 2023-07-15 16:11:42,235 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689437502142.72eac9e91762db39c5e36d093362e297. after waiting 0 ms 2023-07-15 16:11:42,235 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689437502142.72eac9e91762db39c5e36d093362e297. 2023-07-15 16:11:42,235 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689437502142.72eac9e91762db39c5e36d093362e297. 2023-07-15 16:11:42,235 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for 72eac9e91762db39c5e36d093362e297: 2023-07-15 16:11:42,235 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689437502142.909bb1560d27e98b016e0a15f2e6e5ff.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 16:11:42,235 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing 909bb1560d27e98b016e0a15f2e6e5ff, disabling compactions & flushes 2023-07-15 16:11:42,236 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689437502142.909bb1560d27e98b016e0a15f2e6e5ff. 2023-07-15 16:11:42,236 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689437502142.909bb1560d27e98b016e0a15f2e6e5ff. 2023-07-15 16:11:42,236 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689437502142.909bb1560d27e98b016e0a15f2e6e5ff. after waiting 0 ms 2023-07-15 16:11:42,236 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689437502142.909bb1560d27e98b016e0a15f2e6e5ff. 2023-07-15 16:11:42,236 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689437502142.909bb1560d27e98b016e0a15f2e6e5ff. 2023-07-15 16:11:42,236 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for 909bb1560d27e98b016e0a15f2e6e5ff: 2023-07-15 16:11:42,238 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-07-15 16:11:42,239 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689437502142.72eac9e91762db39c5e36d093362e297.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689437502239"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689437502239"}]},"ts":"1689437502239"} 2023-07-15 16:11:42,240 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689437502142.909bb1560d27e98b016e0a15f2e6e5ff.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689437502239"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689437502239"}]},"ts":"1689437502239"} 2023-07-15 16:11:42,242 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-15 16:11:42,244 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-15 16:11:42,244 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689437502244"}]},"ts":"1689437502244"} 2023-07-15 16:11:42,246 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-07-15 16:11:42,249 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-15 16:11:42,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-15 16:11:42,251 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-15 16:11:42,251 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-15 16:11:42,251 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-15 16:11:42,251 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-15 16:11:42,251 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=909bb1560d27e98b016e0a15f2e6e5ff, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=72eac9e91762db39c5e36d093362e297, ASSIGN}] 2023-07-15 16:11:42,254 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=72eac9e91762db39c5e36d093362e297, ASSIGN 2023-07-15 16:11:42,254 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=909bb1560d27e98b016e0a15f2e6e5ff, ASSIGN 2023-07-15 16:11:42,255 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=909bb1560d27e98b016e0a15f2e6e5ff, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43103,1689437454905; forceNewPlan=false, retain=false 2023-07-15 16:11:42,255 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=72eac9e91762db39c5e36d093362e297, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35773,1689437454990; forceNewPlan=false, retain=false 2023-07-15 16:11:42,405 INFO [jenkins-hbase4:37255] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-15 16:11:42,408 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=909bb1560d27e98b016e0a15f2e6e5ff, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:42,408 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=72eac9e91762db39c5e36d093362e297, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:11:42,409 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689437502142.909bb1560d27e98b016e0a15f2e6e5ff.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689437502408"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689437502408"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689437502408"}]},"ts":"1689437502408"} 2023-07-15 16:11:42,409 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689437502142.72eac9e91762db39c5e36d093362e297.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689437502408"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689437502408"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689437502408"}]},"ts":"1689437502408"} 2023-07-15 16:11:42,411 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=43, state=RUNNABLE; OpenRegionProcedure 909bb1560d27e98b016e0a15f2e6e5ff, server=jenkins-hbase4.apache.org,43103,1689437454905}] 2023-07-15 16:11:42,412 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=44, state=RUNNABLE; OpenRegionProcedure 72eac9e91762db39c5e36d093362e297, server=jenkins-hbase4.apache.org,35773,1689437454990}] 2023-07-15 16:11:42,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-15 16:11:42,567 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:11:42,568 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-15 16:11:42,570 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1689437502142.909bb1560d27e98b016e0a15f2e6e5ff. 2023-07-15 16:11:42,571 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 909bb1560d27e98b016e0a15f2e6e5ff, NAME => 'testtb-testConsecutiveExports,,1689437502142.909bb1560d27e98b016e0a15f2e6e5ff.', STARTKEY => '', ENDKEY => '1'} 2023-07-15 16:11:42,572 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1689437502142.909bb1560d27e98b016e0a15f2e6e5ff. service=AccessControlService 2023-07-15 16:11:42,572 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58878, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-15 16:11:42,572 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 16:11:42,573 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 909bb1560d27e98b016e0a15f2e6e5ff 2023-07-15 16:11:42,573 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689437502142.909bb1560d27e98b016e0a15f2e6e5ff.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 16:11:42,573 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 909bb1560d27e98b016e0a15f2e6e5ff 2023-07-15 16:11:42,573 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 909bb1560d27e98b016e0a15f2e6e5ff 2023-07-15 16:11:42,584 INFO [StoreOpener-909bb1560d27e98b016e0a15f2e6e5ff-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 909bb1560d27e98b016e0a15f2e6e5ff 2023-07-15 16:11:42,585 DEBUG [StoreOpener-909bb1560d27e98b016e0a15f2e6e5ff-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testConsecutiveExports/909bb1560d27e98b016e0a15f2e6e5ff/cf 2023-07-15 16:11:42,586 DEBUG [StoreOpener-909bb1560d27e98b016e0a15f2e6e5ff-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testConsecutiveExports/909bb1560d27e98b016e0a15f2e6e5ff/cf 2023-07-15 16:11:42,586 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1689437502142.72eac9e91762db39c5e36d093362e297. 2023-07-15 16:11:42,586 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 72eac9e91762db39c5e36d093362e297, NAME => 'testtb-testConsecutiveExports,1,1689437502142.72eac9e91762db39c5e36d093362e297.', STARTKEY => '1', ENDKEY => ''} 2023-07-15 16:11:42,586 INFO [StoreOpener-909bb1560d27e98b016e0a15f2e6e5ff-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 909bb1560d27e98b016e0a15f2e6e5ff columnFamilyName cf 2023-07-15 16:11:42,586 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1689437502142.72eac9e91762db39c5e36d093362e297. service=AccessControlService 2023-07-15 16:11:42,586 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 16:11:42,587 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 72eac9e91762db39c5e36d093362e297 2023-07-15 16:11:42,587 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689437502142.72eac9e91762db39c5e36d093362e297.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 16:11:42,587 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 72eac9e91762db39c5e36d093362e297 2023-07-15 16:11:42,587 INFO [StoreOpener-909bb1560d27e98b016e0a15f2e6e5ff-1] regionserver.HStore(310): Store=909bb1560d27e98b016e0a15f2e6e5ff/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 16:11:42,587 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 72eac9e91762db39c5e36d093362e297 2023-07-15 16:11:42,588 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testConsecutiveExports/909bb1560d27e98b016e0a15f2e6e5ff 2023-07-15 16:11:42,588 INFO [StoreOpener-72eac9e91762db39c5e36d093362e297-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 72eac9e91762db39c5e36d093362e297 2023-07-15 16:11:42,588 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testConsecutiveExports/909bb1560d27e98b016e0a15f2e6e5ff 2023-07-15 16:11:42,590 DEBUG [StoreOpener-72eac9e91762db39c5e36d093362e297-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testConsecutiveExports/72eac9e91762db39c5e36d093362e297/cf 2023-07-15 16:11:42,590 DEBUG [StoreOpener-72eac9e91762db39c5e36d093362e297-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testConsecutiveExports/72eac9e91762db39c5e36d093362e297/cf 2023-07-15 16:11:42,590 INFO [StoreOpener-72eac9e91762db39c5e36d093362e297-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 72eac9e91762db39c5e36d093362e297 columnFamilyName cf 2023-07-15 16:11:42,591 INFO [StoreOpener-72eac9e91762db39c5e36d093362e297-1] regionserver.HStore(310): Store=72eac9e91762db39c5e36d093362e297/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 16:11:42,591 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 909bb1560d27e98b016e0a15f2e6e5ff 2023-07-15 16:11:42,591 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testConsecutiveExports/72eac9e91762db39c5e36d093362e297 2023-07-15 16:11:42,592 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testConsecutiveExports/72eac9e91762db39c5e36d093362e297 2023-07-15 16:11:42,593 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testConsecutiveExports/909bb1560d27e98b016e0a15f2e6e5ff/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 16:11:42,593 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 909bb1560d27e98b016e0a15f2e6e5ff; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63544283, jitterRate=-0.05311639606952667}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 16:11:42,593 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 909bb1560d27e98b016e0a15f2e6e5ff: 2023-07-15 16:11:42,594 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1689437502142.909bb1560d27e98b016e0a15f2e6e5ff., pid=45, masterSystemTime=1689437502563 2023-07-15 16:11:42,595 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 72eac9e91762db39c5e36d093362e297 2023-07-15 16:11:42,596 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1689437502142.909bb1560d27e98b016e0a15f2e6e5ff. 2023-07-15 16:11:42,596 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1689437502142.909bb1560d27e98b016e0a15f2e6e5ff. 2023-07-15 16:11:42,598 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=909bb1560d27e98b016e0a15f2e6e5ff, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:42,598 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1689437502142.909bb1560d27e98b016e0a15f2e6e5ff.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689437502598"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689437502598"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689437502598"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689437502598"}]},"ts":"1689437502598"} 2023-07-15 16:11:42,598 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testConsecutiveExports/72eac9e91762db39c5e36d093362e297/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 16:11:42,599 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 72eac9e91762db39c5e36d093362e297; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70590613, jitterRate=0.05188210308551788}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 16:11:42,599 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 72eac9e91762db39c5e36d093362e297: 2023-07-15 16:11:42,600 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1689437502142.72eac9e91762db39c5e36d093362e297., pid=46, masterSystemTime=1689437502567 2023-07-15 16:11:42,605 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1689437502142.72eac9e91762db39c5e36d093362e297. 2023-07-15 16:11:42,605 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1689437502142.72eac9e91762db39c5e36d093362e297. 2023-07-15 16:11:42,606 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=72eac9e91762db39c5e36d093362e297, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:11:42,606 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=43 2023-07-15 16:11:42,606 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=43, state=SUCCESS; OpenRegionProcedure 909bb1560d27e98b016e0a15f2e6e5ff, server=jenkins-hbase4.apache.org,43103,1689437454905 in 189 msec 2023-07-15 16:11:42,606 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1689437502142.72eac9e91762db39c5e36d093362e297.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689437502606"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689437502606"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689437502606"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689437502606"}]},"ts":"1689437502606"} 2023-07-15 16:11:42,607 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=909bb1560d27e98b016e0a15f2e6e5ff, ASSIGN in 355 msec 2023-07-15 16:11:42,609 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=44 2023-07-15 16:11:42,609 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=44, state=SUCCESS; OpenRegionProcedure 72eac9e91762db39c5e36d093362e297, server=jenkins-hbase4.apache.org,35773,1689437454990 in 196 msec 2023-07-15 16:11:42,611 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=42 2023-07-15 16:11:42,611 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=72eac9e91762db39c5e36d093362e297, ASSIGN in 358 msec 2023-07-15 16:11:42,612 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-15 16:11:42,612 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689437502612"}]},"ts":"1689437502612"} 2023-07-15 16:11:42,614 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-07-15 16:11:42,616 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-07-15 16:11:42,616 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-07-15 16:11:42,618 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43103] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-15 16:11:42,621 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 16:11:42,621 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 16:11:42,621 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 16:11:42,621 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 16:11:42,622 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-15 16:11:42,623 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-15 16:11:42,623 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-15 16:11:42,624 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 479 msec 2023-07-15 16:11:42,624 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-15 16:11:42,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-15 16:11:42,753 INFO [Listener at jenkins-hbase4.apache.org/42699] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-07-15 16:11:42,753 DEBUG [Listener at jenkins-hbase4.apache.org/42699] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testConsecutiveExports get assigned. Timeout = 60000ms 2023-07-15 16:11:42,753 INFO [Listener at jenkins-hbase4.apache.org/42699] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 16:11:42,757 INFO [Listener at jenkins-hbase4.apache.org/42699] hbase.HBaseTestingUtility(3484): All regions for table testtb-testConsecutiveExports assigned to meta. Checking AM states. 2023-07-15 16:11:42,757 INFO [Listener at jenkins-hbase4.apache.org/42699] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 16:11:42,757 INFO [Listener at jenkins-hbase4.apache.org/42699] hbase.HBaseTestingUtility(3504): All regions for table testtb-testConsecutiveExports assigned. 2023-07-15 16:11:42,761 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-15 16:11:42,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689437502761 (current time:1689437502761). 2023-07-15 16:11:42,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 16:11:42,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] zookeeper.ReadOnlyZKClient(139): Connect 0x0542caf3 to 127.0.0.1:58438 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 16:11:42,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5edd495a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 16:11:42,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 16:11:42,773 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58626, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 16:11:42,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0542caf3 to 127.0.0.1:58438 2023-07-15 16:11:42,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 16:11:42,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] zookeeper.ReadOnlyZKClient(139): Connect 0x20d01dde to 127.0.0.1:58438 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 16:11:42,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@33564e65, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 16:11:42,787 DEBUG [hconnection-0x77546cc-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 16:11:42,790 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58642, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 16:11:42,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x20d01dde to 127.0.0.1:58438 2023-07-15 16:11:42,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 16:11:42,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-15 16:11:42,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 16:11:42,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-15 16:11:42,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] procedure2.ProcedureExecutor(1029): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-15 16:11:42,799 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-15 16:11:42,799 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689438102799 2023-07-15 16:11:42,799 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-15 16:11:42,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-15 16:11:42,801 DEBUG [Listener at jenkins-hbase4.apache.org/42699] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 16:11:42,801 DEBUG [Listener at jenkins-hbase4.apache.org/42699] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 16:11:42,804 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-15 16:11:42,804 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-15 16:11:42,805 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 7 msec 2023-07-15 16:11:42,806 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-15 16:11:42,807 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689438102807 2023-07-15 16:11:42,826 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:42,826 INFO [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-07-15 16:11:42,826 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 16:11:42,828 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-07-15 16:11:42,828 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-15 16:11:42,828 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:42,828 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:42,829 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:11:42,830 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:11:42,830 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:11:42,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:11:42,830 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:11:42,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:11:42,830 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:11:42,830 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:11:42,830 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:11:42,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:11:42,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:42,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:42,830 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:11:42,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:42,830 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:42,830 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:42,831 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:42,831 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:42,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-15 16:11:42,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:42,831 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:42,831 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 16:11:42,831 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-15 16:11:42,831 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:42,831 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-15 16:11:42,832 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 16:11:42,833 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-15 16:11:42,833 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-15 16:11:42,833 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35773,1689437454990' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-15 16:11:42,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-15 16:11:42,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:42,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-15 16:11:42,833 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-15 16:11:42,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:42,834 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:42,834 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-15 16:11:42,834 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-15 16:11:42,834 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 16:11:42,835 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-15 16:11:42,835 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:42,835 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-15 16:11:42,835 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43103,1689437454905' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-15 16:11:42,835 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-15 16:11:42,835 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 16:11:42,835 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:42,835 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:11:42,839 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-15 16:11:42,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:11:42,839 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-15 16:11:42,839 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45149,1689437455062' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-15 16:11:42,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:11:42,840 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:42,840 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 16:11:42,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:11:42,842 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:42,842 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:42,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:11:42,842 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:42,842 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:42,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:11:42,843 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 16:11:42,843 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:42,843 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 16:11:42,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:42,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:11:42,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:11:42,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:42,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:11:42,844 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35773,1689437454990' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-15 16:11:42,844 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@175645b9[Count = 1] remaining members to acquire global barrier 2023-07-15 16:11:42,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:42,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:11:42,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:11:42,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:11:42,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:11:42,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:42,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:11:42,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:11:42,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:42,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:11:42,846 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43103,1689437454905' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-15 16:11:42,846 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@175645b9[Count = 0] remaining members to acquire global barrier 2023-07-15 16:11:42,846 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-15 16:11:42,846 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:42,848 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:42,848 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:42,848 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:42,848 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:42,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:42,848 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:42,848 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-15 16:11:42,848 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:11:42,848 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:42,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:42,848 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 16:11:42,848 DEBUG [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689437502142.909bb1560d27e98b016e0a15f2e6e5ff. 2023-07-15 16:11:42,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:42,848 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:42,848 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-15 16:11:42,848 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 16:11:42,848 DEBUG [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689437502142.909bb1560d27e98b016e0a15f2e6e5ff. started... 2023-07-15 16:11:42,848 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 16:11:42,848 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-15 16:11:42,848 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-15 16:11:42,849 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,45149,1689437455062' in zk 2023-07-15 16:11:42,850 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 16:11:42,850 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 16:11:42,850 DEBUG [rs(jenkins-hbase4.apache.org,35773,1689437454990)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689437502142.72eac9e91762db39c5e36d093362e297. 2023-07-15 16:11:42,850 DEBUG [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 909bb1560d27e98b016e0a15f2e6e5ff: 2023-07-15 16:11:42,850 DEBUG [rs(jenkins-hbase4.apache.org,35773,1689437454990)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689437502142.72eac9e91762db39c5e36d093362e297. started... 2023-07-15 16:11:42,851 DEBUG [rs(jenkins-hbase4.apache.org,35773,1689437454990)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 72eac9e91762db39c5e36d093362e297: 2023-07-15 16:11:42,851 DEBUG [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689437502142.909bb1560d27e98b016e0a15f2e6e5ff.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:42,852 DEBUG [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 16:11:42,852 DEBUG [rs(jenkins-hbase4.apache.org,35773,1689437454990)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689437502142.72eac9e91762db39c5e36d093362e297.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:42,852 DEBUG [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-15 16:11:42,852 DEBUG [rs(jenkins-hbase4.apache.org,35773,1689437454990)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 16:11:42,852 DEBUG [rs(jenkins-hbase4.apache.org,35773,1689437454990)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-15 16:11:42,862 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-15 16:11:42,863 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 16:11:42,863 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-15 16:11:42,863 DEBUG [rs(jenkins-hbase4.apache.org,35773,1689437454990)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689437502142.72eac9e91762db39c5e36d093362e297. completed. 2023-07-15 16:11:42,863 DEBUG [rs(jenkins-hbase4.apache.org,35773,1689437454990)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689437502142.72eac9e91762db39c5e36d093362e297. 2023-07-15 16:11:42,863 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 16:11:42,863 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 16:11:42,866 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:11:42,866 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-15 16:11:42,866 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,35773,1689437454990' in zk 2023-07-15 16:11:42,868 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-15 16:11:42,868 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:11:42,868 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 16:11:42,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:11:42,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:11:42,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:11:42,868 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-15 16:11:42,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:11:42,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:11:42,870 DEBUG [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689437502142.909bb1560d27e98b016e0a15f2e6e5ff. completed. 2023-07-15 16:11:42,871 DEBUG [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689437502142.909bb1560d27e98b016e0a15f2e6e5ff. 2023-07-15 16:11:42,871 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 16:11:42,871 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 16:11:42,871 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:42,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:42,871 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-15 16:11:42,871 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,43103,1689437454905' in zk 2023-07-15 16:11:42,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:11:42,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:11:42,873 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:42,873 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-15 16:11:42,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:42,873 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 16:11:42,873 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-15 16:11:42,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:11:42,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:42,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:11:42,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:11:42,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:42,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,35773,1689437454990': 2023-07-15 16:11:42,876 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35773,1689437454990' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-15 16:11:42,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:42,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:11:42,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:11:42,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:11:42,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:11:42,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:42,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:11:42,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:11:42,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:42,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:11:42,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:42,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:11:42,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:11:42,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:42,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,43103,1689437454905': 2023-07-15 16:11:42,882 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43103,1689437454905' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-15 16:11:42,882 INFO [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-07-15 16:11:42,882 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 16:11:42,882 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 16:11:42,882 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:42,882 INFO [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 16:11:42,884 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:42,884 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:42,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:42,884 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:42,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:11:42,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:11:42,884 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:11:42,884 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:42,884 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:42,884 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:42,884 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:42,884 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:11:42,884 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:11:42,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:42,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:42,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:42,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:11:42,885 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:11:42,885 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:11:42,885 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:11:42,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:11:42,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:11:42,885 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:11:42,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:11:42,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:42,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:42,886 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:11:42,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:42,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:11:42,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:42,887 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:42,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:42,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:11:42,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:11:42,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:42,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:11:42,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:42,890 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:11:42,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:11:42,890 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:11:42,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:11:42,890 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:42,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:42,894 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:42,895 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:11:42,895 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:11:42,895 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:11:42,895 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:11:42,895 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:11:42,895 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:11:42,895 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:11:42,895 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:42,895 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:42,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:11:42,895 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:42,895 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:11:42,895 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:11:42,895 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:42,896 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:42,896 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:42,896 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:11:42,896 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:11:42,896 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:42,896 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:42,895 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:11:42,895 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 16:11:42,895 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:11:42,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:11:42,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:11:42,896 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:11:42,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:11:42,896 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:42,898 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:11:42,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:11:42,899 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:11:42,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:11:42,901 DEBUG [Listener at jenkins-hbase4.apache.org/42699] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 16:11:42,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-15 16:11:42,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-15 16:11:42,903 DEBUG [Listener at jenkins-hbase4.apache.org/42699] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 16:11:42,930 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:42,952 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-15 16:11:42,952 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:42,952 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:42,952 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689437502800Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1689437502895 (+95 ms)Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1689437502895Writing data manifest for emptySnaptb0-testConsecutiveExports at 1689437502901 (+6 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1689437502924 (+23 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689437502952 (+28 ms) 2023-07-15 16:11:42,955 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-15 16:11:42,957 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 155 msec 2023-07-15 16:11:43,103 DEBUG [Listener at jenkins-hbase4.apache.org/42699] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 16:11:43,104 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-15 16:11:43,104 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 16:11:43,111 DEBUG [htable-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 16:11:43,112 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43103] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1689437502142.909bb1560d27e98b016e0a15f2e6e5ff. with WAL disabled. Data may be lost in the event of a crash. 2023-07-15 16:11:43,120 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58884, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 16:11:43,122 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35773] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1689437502142.72eac9e91762db39c5e36d093362e297. with WAL disabled. Data may be lost in the event of a crash. 2023-07-15 16:11:43,126 DEBUG [Listener at jenkins-hbase4.apache.org/42699] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-15 16:11:43,126 DEBUG [Listener at jenkins-hbase4.apache.org/42699] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689437502142.909bb1560d27e98b016e0a15f2e6e5ff. 2023-07-15 16:11:43,127 INFO [Listener at jenkins-hbase4.apache.org/42699] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 16:11:43,146 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-15 16:11:43,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689437503146 (current time:1689437503146). 2023-07-15 16:11:43,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 16:11:43,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] zookeeper.ReadOnlyZKClient(139): Connect 0x7f27da88 to 127.0.0.1:58438 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 16:11:43,161 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3aab7fb5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 16:11:43,164 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 16:11:43,167 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58648, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 16:11:43,169 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7f27da88 to 127.0.0.1:58438 2023-07-15 16:11:43,169 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 16:11:43,169 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] zookeeper.ReadOnlyZKClient(139): Connect 0x64752e66 to 127.0.0.1:58438 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 16:11:43,181 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@25474bfa, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 16:11:43,183 DEBUG [hconnection-0x4470de30-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 16:11:43,184 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58660, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 16:11:43,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x64752e66 to 127.0.0.1:58438 2023-07-15 16:11:43,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 16:11:43,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-15 16:11:43,193 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 16:11:43,193 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-15 16:11:43,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-15 16:11:43,197 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-15 16:11:43,198 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689438103198 2023-07-15 16:11:43,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-15 16:11:43,198 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-15 16:11:43,199 DEBUG [Listener at jenkins-hbase4.apache.org/42699] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 16:11:43,199 DEBUG [Listener at jenkins-hbase4.apache.org/42699] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 16:11:43,201 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-15 16:11:43,201 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-15 16:11:43,202 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 7 msec 2023-07-15 16:11:43,203 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-15 16:11:43,204 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689438103204 2023-07-15 16:11:43,214 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-07-15 16:11:43,214 INFO [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-07-15 16:11:43,214 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 16:11:43,215 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-07-15 16:11:43,215 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-15 16:11:43,216 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 16:11:43,216 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-15 16:11:43,217 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:11:43,217 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:11:43,217 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:11:43,217 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:11:43,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:11:43,217 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:11:43,217 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:11:43,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:11:43,218 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:11:43,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:11:43,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-15 16:11:43,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-15 16:11:43,218 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:11:43,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-15 16:11:43,218 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:43,219 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 16:11:43,219 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 16:11:43,219 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 16:11:43,219 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:43,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-15 16:11:43,219 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 16:11:43,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-15 16:11:43,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-15 16:11:43,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-15 16:11:43,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-15 16:11:43,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-15 16:11:43,219 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-15 16:11:43,219 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-15 16:11:43,219 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-15 16:11:43,222 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-15 16:11:43,222 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-15 16:11:43,223 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-15 16:11:43,223 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-15 16:11:43,223 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 16:11:43,223 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-15 16:11:43,224 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-15 16:11:43,224 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-15 16:11:43,223 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 16:11:43,224 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35773,1689437454990' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-15 16:11:43,224 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-15 16:11:43,225 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 16:11:43,225 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-15 16:11:43,226 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-15 16:11:43,226 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-15 16:11:43,226 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-15 16:11:43,226 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43103,1689437454905' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-15 16:11:43,226 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45149,1689437455062' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-15 16:11:43,227 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 16:11:43,227 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:11:43,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:11:43,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:11:43,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:11:43,228 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 16:11:43,228 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:43,230 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 16:11:43,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:11:43,230 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 16:11:43,230 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 16:11:43,230 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 16:11:43,230 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 16:11:43,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:11:43,231 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 16:11:43,231 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 16:11:43,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-15 16:11:43,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:11:43,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:11:43,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:43,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:11:43,232 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35773,1689437454990' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-15 16:11:43,232 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7e03d4bf[Count = 1] remaining members to acquire global barrier 2023-07-15 16:11:43,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:43,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:11:43,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:11:43,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:11:43,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:11:43,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-15 16:11:43,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:11:43,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:11:43,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:43,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:11:43,235 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43103,1689437454905' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-15 16:11:43,235 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7e03d4bf[Count = 0] remaining members to acquire global barrier 2023-07-15 16:11:43,235 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-15 16:11:43,235 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 16:11:43,236 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 16:11:43,236 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 16:11:43,236 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 16:11:43,236 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 16:11:43,236 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 16:11:43,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 16:11:43,236 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:11:43,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 16:11:43,236 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 16:11:43,237 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-15 16:11:43,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 16:11:43,237 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-15 16:11:43,237 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 16:11:43,236 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-15 16:11:43,237 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 16:11:43,237 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 16:11:43,237 DEBUG [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689437502142.909bb1560d27e98b016e0a15f2e6e5ff. 2023-07-15 16:11:43,237 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:43,237 DEBUG [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689437502142.909bb1560d27e98b016e0a15f2e6e5ff. started... 2023-07-15 16:11:43,237 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 16:11:43,237 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 16:11:43,237 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-15 16:11:43,237 DEBUG [rs(jenkins-hbase4.apache.org,35773,1689437454990)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689437502142.72eac9e91762db39c5e36d093362e297. 2023-07-15 16:11:43,237 INFO [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 909bb1560d27e98b016e0a15f2e6e5ff 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-15 16:11:43,237 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,45149,1689437455062' in zk 2023-07-15 16:11:43,237 DEBUG [rs(jenkins-hbase4.apache.org,35773,1689437454990)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689437502142.72eac9e91762db39c5e36d093362e297. started... 2023-07-15 16:11:43,240 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-15 16:11:43,240 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 16:11:43,240 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-15 16:11:43,241 INFO [rs(jenkins-hbase4.apache.org,35773,1689437454990)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 72eac9e91762db39c5e36d093362e297 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-15 16:11:43,264 INFO [rs(jenkins-hbase4.apache.org,35773,1689437454990)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.06 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testConsecutiveExports/72eac9e91762db39c5e36d093362e297/.tmp/cf/0f9f4f95c2a1439096adb1de278b5fb8 2023-07-15 16:11:43,276 INFO [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=199 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testConsecutiveExports/909bb1560d27e98b016e0a15f2e6e5ff/.tmp/cf/a90208876b964acd80c3ea59dd7439a2 2023-07-15 16:11:43,278 DEBUG [rs(jenkins-hbase4.apache.org,35773,1689437454990)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testConsecutiveExports/72eac9e91762db39c5e36d093362e297/.tmp/cf/0f9f4f95c2a1439096adb1de278b5fb8 as hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testConsecutiveExports/72eac9e91762db39c5e36d093362e297/cf/0f9f4f95c2a1439096adb1de278b5fb8 2023-07-15 16:11:43,286 INFO [rs(jenkins-hbase4.apache.org,35773,1689437454990)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testConsecutiveExports/72eac9e91762db39c5e36d093362e297/cf/0f9f4f95c2a1439096adb1de278b5fb8, entries=47, sequenceid=6, filesize=8.0 K 2023-07-15 16:11:43,286 DEBUG [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testConsecutiveExports/909bb1560d27e98b016e0a15f2e6e5ff/.tmp/cf/a90208876b964acd80c3ea59dd7439a2 as hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testConsecutiveExports/909bb1560d27e98b016e0a15f2e6e5ff/cf/a90208876b964acd80c3ea59dd7439a2 2023-07-15 16:11:43,287 INFO [rs(jenkins-hbase4.apache.org,35773,1689437454990)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 72eac9e91762db39c5e36d093362e297 in 49ms, sequenceid=6, compaction requested=false 2023-07-15 16:11:43,288 DEBUG [rs(jenkins-hbase4.apache.org,35773,1689437454990)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-15 16:11:43,288 DEBUG [rs(jenkins-hbase4.apache.org,35773,1689437454990)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 72eac9e91762db39c5e36d093362e297: 2023-07-15 16:11:43,288 DEBUG [rs(jenkins-hbase4.apache.org,35773,1689437454990)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689437502142.72eac9e91762db39c5e36d093362e297.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-15 16:11:43,288 DEBUG [rs(jenkins-hbase4.apache.org,35773,1689437454990)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 16:11:43,288 DEBUG [rs(jenkins-hbase4.apache.org,35773,1689437454990)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testConsecutiveExports/72eac9e91762db39c5e36d093362e297/cf/0f9f4f95c2a1439096adb1de278b5fb8] hfiles 2023-07-15 16:11:43,288 DEBUG [rs(jenkins-hbase4.apache.org,35773,1689437454990)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testConsecutiveExports/72eac9e91762db39c5e36d093362e297/cf/0f9f4f95c2a1439096adb1de278b5fb8 for snapshot=snaptb0-testConsecutiveExports 2023-07-15 16:11:43,293 INFO [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testConsecutiveExports/909bb1560d27e98b016e0a15f2e6e5ff/cf/a90208876b964acd80c3ea59dd7439a2, entries=3, sequenceid=6, filesize=5.0 K 2023-07-15 16:11:43,294 INFO [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 909bb1560d27e98b016e0a15f2e6e5ff in 57ms, sequenceid=6, compaction requested=false 2023-07-15 16:11:43,295 DEBUG [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 909bb1560d27e98b016e0a15f2e6e5ff: 2023-07-15 16:11:43,295 DEBUG [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689437502142.909bb1560d27e98b016e0a15f2e6e5ff.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-15 16:11:43,295 DEBUG [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 16:11:43,296 DEBUG [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testConsecutiveExports/909bb1560d27e98b016e0a15f2e6e5ff/cf/a90208876b964acd80c3ea59dd7439a2] hfiles 2023-07-15 16:11:43,297 DEBUG [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testConsecutiveExports/909bb1560d27e98b016e0a15f2e6e5ff/cf/a90208876b964acd80c3ea59dd7439a2 for snapshot=snaptb0-testConsecutiveExports 2023-07-15 16:11:43,300 DEBUG [Listener at jenkins-hbase4.apache.org/42699] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 16:11:43,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-15 16:11:43,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-15 16:11:43,301 DEBUG [Listener at jenkins-hbase4.apache.org/42699] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 16:11:43,308 DEBUG [rs(jenkins-hbase4.apache.org,35773,1689437454990)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689437502142.72eac9e91762db39c5e36d093362e297. completed. 2023-07-15 16:11:43,308 DEBUG [rs(jenkins-hbase4.apache.org,35773,1689437454990)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689437502142.72eac9e91762db39c5e36d093362e297. 2023-07-15 16:11:43,308 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 16:11:43,308 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 16:11:43,308 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:11:43,308 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-15 16:11:43,308 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,35773,1689437454990' in zk 2023-07-15 16:11:43,311 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:11:43,311 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-15 16:11:43,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:11:43,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:11:43,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:11:43,311 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 16:11:43,311 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-15 16:11:43,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:11:43,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:11:43,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-15 16:11:43,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:11:43,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:11:43,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:43,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:11:43,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-15 16:11:43,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:11:43,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:11:43,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,35773,1689437454990': 2023-07-15 16:11:43,320 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35773,1689437454990' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-15 16:11:43,331 DEBUG [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689437502142.909bb1560d27e98b016e0a15f2e6e5ff. completed. 2023-07-15 16:11:43,331 DEBUG [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689437502142.909bb1560d27e98b016e0a15f2e6e5ff. 2023-07-15 16:11:43,331 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 16:11:43,331 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 16:11:43,331 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:43,331 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-15 16:11:43,331 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,43103,1689437454905' in zk 2023-07-15 16:11:43,335 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:43,335 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-15 16:11:43,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:43,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:11:43,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:11:43,335 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 16:11:43,336 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-15 16:11:43,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:11:43,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:11:43,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-15 16:11:43,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:11:43,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:11:43,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:43,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:11:43,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-15 16:11:43,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:11:43,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:11:43,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:43,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,43103,1689437454905': 2023-07-15 16:11:43,342 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43103,1689437454905' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-15 16:11:43,343 INFO [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-07-15 16:11:43,343 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 16:11:43,343 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 16:11:43,343 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-07-15 16:11:43,343 INFO [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 16:11:43,345 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 16:11:43,345 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:11:43,345 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 16:11:43,345 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 16:11:43,345 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 16:11:43,345 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:11:43,345 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 16:11:43,345 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 16:11:43,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 16:11:43,345 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 16:11:43,345 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:11:43,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 16:11:43,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:11:43,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:11:43,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 16:11:43,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 16:11:43,346 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:11:43,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:11:43,346 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:11:43,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:11:43,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:11:43,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 16:11:43,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-15 16:11:43,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 16:11:43,347 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:11:43,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:11:43,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:11:43,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 16:11:43,348 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:11:43,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-15 16:11:43,348 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:11:43,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:11:43,349 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:43,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:11:43,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:43,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:11:43,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-15 16:11:43,355 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:11:43,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:11:43,356 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:11:43,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:11:43,356 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:43,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:43,364 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:11:43,364 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:11:43,364 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:11:43,364 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:11:43,364 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:11:43,364 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:11:43,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:11:43,364 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:11:43,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:11:43,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:11:43,364 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:11:43,364 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:11:43,365 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:11:43,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:11:43,365 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:11:43,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:11:43,367 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:43,367 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-15 16:11:43,367 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:11:43,367 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:11:43,367 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-15 16:11:43,367 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:11:43,367 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 16:11:43,367 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:11:43,367 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-07-15 16:11:43,367 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 16:11:43,367 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-07-15 16:11:43,367 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:11:43,369 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 16:11:43,369 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 16:11:43,369 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:11:43,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:11:43,370 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-15 16:11:43,501 DEBUG [Listener at jenkins-hbase4.apache.org/42699] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 16:11:43,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-15 16:11:43,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-15 16:11:43,503 DEBUG [Listener at jenkins-hbase4.apache.org/42699] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-15 16:11:43,803 DEBUG [Listener at jenkins-hbase4.apache.org/42699] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 16:11:43,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-15 16:11:43,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-15 16:11:43,804 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-15 16:11:43,804 DEBUG [Listener at jenkins-hbase4.apache.org/42699] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-15 16:11:43,823 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-15 16:11:43,824 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-15 16:11:43,824 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-15 16:11:43,824 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689437503198Consolidate snapshot: snaptb0-testConsecutiveExports at 1689437503367 (+169 ms)Loading Region manifests for snaptb0-testConsecutiveExports at 1689437503369 (+2 ms)Writing data manifest for snaptb0-testConsecutiveExports at 1689437503379 (+10 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1689437503797 (+418 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689437503823 (+26 ms) 2023-07-15 16:11:43,827 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-15 16:11:43,828 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 628 msec 2023-07-15 16:11:44,305 DEBUG [Listener at jenkins-hbase4.apache.org/42699] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 16:11:44,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-15 16:11:44,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 16:11:44,306 INFO [Listener at jenkins-hbase4.apache.org/42699] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1587f29c-5daf-234a-1773-5088522b715e/local-export-1689437504306 2023-07-15 16:11:44,306 INFO [Listener at jenkins-hbase4.apache.org/42699] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1587f29c-5daf-234a-1773-5088522b715e/local-export-1689437504306, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1587f29c-5daf-234a-1773-5088522b715e/local-export-1689437504306, srcFsUri=hdfs://localhost:44749, srcDir=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8 2023-07-15 16:11:44,330 DEBUG [Listener at jenkins-hbase4.apache.org/42699] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44749, inputRoot=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8 2023-07-15 16:11:44,330 DEBUG [Listener at jenkins-hbase4.apache.org/42699] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@2fd9a9b9, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1587f29c-5daf-234a-1773-5088522b715e/local-export-1689437504306, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1587f29c-5daf-234a-1773-5088522b715e/local-export-1689437504306/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-15 16:11:44,330 INFO [Listener at jenkins-hbase4.apache.org/42699] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44749, inputRoot=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8, snapshotDir=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-15 16:11:44,338 INFO [Listener at jenkins-hbase4.apache.org/42699] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1587f29c-5daf-234a-1773-5088522b715e/local-export-1689437504306/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-15 16:11:44,350 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-15 16:11:44,351 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-15 16:11:44,351 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-15 16:11:44,351 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-15 16:11:45,342 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1587f29c-5daf-234a-1773-5088522b715e/hadoop-7410096969927422904.jar 2023-07-15 16:11:45,342 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-15 16:11:45,343 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-15 16:11:45,409 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1587f29c-5daf-234a-1773-5088522b715e/hadoop-8287510478272051093.jar 2023-07-15 16:11:45,410 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-15 16:11:45,410 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-15 16:11:45,411 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-15 16:11:45,411 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-15 16:11:45,411 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-15 16:11:45,412 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-15 16:11:45,412 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-15 16:11:45,412 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-15 16:11:45,413 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-15 16:11:45,413 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-15 16:11:45,413 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-15 16:11:45,414 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-15 16:11:45,414 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-15 16:11:45,415 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-15 16:11:45,415 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-15 16:11:45,415 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-15 16:11:45,416 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 16:11:45,416 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 16:11:45,417 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 16:11:45,417 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 16:11:45,417 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 16:11:45,418 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 16:11:45,418 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 16:11:45,780 WARN [Listener at jenkins-hbase4.apache.org/42699] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-15 16:11:45,783 INFO [Listener at jenkins-hbase4.apache.org/42699] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-15 16:11:45,785 DEBUG [Listener at jenkins-hbase4.apache.org/42699] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-15 16:11:46,052 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 16:11:46,053 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 16:11:46,055 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689437464006_0002_000001 (auth:SIMPLE) 2023-07-15 16:11:46,758 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689437464006_0003_000001 (auth:SIMPLE) 2023-07-15 16:11:47,428 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-15 16:11:51,246 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689437464006_0003_000001 (auth:SIMPLE) 2023-07-15 16:11:53,483 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689437464006_0003_000001 (auth:SIMPLE) 2023-07-15 16:11:56,127 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689437464006_0003_000001 (auth:SIMPLE) 2023-07-15 16:11:57,971 INFO [Listener at jenkins-hbase4.apache.org/42699] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-15 16:11:57,971 INFO [Listener at jenkins-hbase4.apache.org/42699] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-15 16:11:57,975 INFO [Listener at jenkins-hbase4.apache.org/42699] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-15 16:11:57,975 INFO [Listener at jenkins-hbase4.apache.org/42699] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-15 16:11:57,975 INFO [Listener at jenkins-hbase4.apache.org/42699] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-15 16:11:57,976 DEBUG [Listener at jenkins-hbase4.apache.org/42699] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-127961896_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-15 16:11:57,976 DEBUG [Listener at jenkins-hbase4.apache.org/42699] snapshot.TestExportSnapshot(367): hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-15 16:11:57,976 DEBUG [Listener at jenkins-hbase4.apache.org/42699] snapshot.TestExportSnapshot(367): hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-15 16:11:57,976 DEBUG [Listener at jenkins-hbase4.apache.org/42699] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@658c0b in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1587f29c-5daf-234a-1773-5088522b715e/local-export-1689437504306/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1587f29c-5daf-234a-1773-5088522b715e/local-export-1689437504306/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-15 16:11:57,977 DEBUG [Listener at jenkins-hbase4.apache.org/42699] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1587f29c-5daf-234a-1773-5088522b715e/local-export-1689437504306/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-15 16:11:57,977 DEBUG [Listener at jenkins-hbase4.apache.org/42699] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1587f29c-5daf-234a-1773-5088522b715e/local-export-1689437504306/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-15 16:11:57,978 INFO [Listener at jenkins-hbase4.apache.org/42699] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1587f29c-5daf-234a-1773-5088522b715e/local-export-1689437504306, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1587f29c-5daf-234a-1773-5088522b715e/local-export-1689437504306, srcFsUri=hdfs://localhost:44749, srcDir=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8 2023-07-15 16:11:58,002 DEBUG [Listener at jenkins-hbase4.apache.org/42699] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44749, inputRoot=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8 2023-07-15 16:11:58,002 DEBUG [Listener at jenkins-hbase4.apache.org/42699] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@6c5331d0, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1587f29c-5daf-234a-1773-5088522b715e/local-export-1689437504306, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1587f29c-5daf-234a-1773-5088522b715e/local-export-1689437504306/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-15 16:11:58,002 INFO [Listener at jenkins-hbase4.apache.org/42699] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44749, inputRoot=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8, snapshotDir=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-15 16:11:58,010 INFO [Listener at jenkins-hbase4.apache.org/42699] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1587f29c-5daf-234a-1773-5088522b715e/local-export-1689437504306/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-15 16:11:58,022 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-15 16:11:58,023 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-15 16:11:58,023 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-15 16:11:58,023 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-15 16:11:58,929 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1587f29c-5daf-234a-1773-5088522b715e/hadoop-3215726561893955666.jar 2023-07-15 16:11:58,929 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-15 16:11:58,930 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-15 16:11:58,998 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1587f29c-5daf-234a-1773-5088522b715e/hadoop-8280160140227168741.jar 2023-07-15 16:11:58,999 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-15 16:11:58,999 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-15 16:11:59,000 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-15 16:11:59,000 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-15 16:11:59,001 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-15 16:11:59,001 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-15 16:11:59,001 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-15 16:11:59,002 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-15 16:11:59,002 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-15 16:11:59,002 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-15 16:11:59,003 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-15 16:11:59,003 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-15 16:11:59,003 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-15 16:11:59,004 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-15 16:11:59,004 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-15 16:11:59,005 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-15 16:11:59,005 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 16:11:59,006 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 16:11:59,006 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 16:11:59,006 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 16:11:59,007 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 16:11:59,007 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 16:11:59,008 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 16:11:59,436 WARN [Listener at jenkins-hbase4.apache.org/42699] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-15 16:11:59,439 INFO [Listener at jenkins-hbase4.apache.org/42699] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-15 16:11:59,441 DEBUG [Listener at jenkins-hbase4.apache.org/42699] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-15 16:12:02,304 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 16:12:02,304 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 16:12:02,306 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689437464006_0003_000001 (auth:SIMPLE) 2023-07-15 16:12:03,069 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689437464006_0004_000001 (auth:SIMPLE) 2023-07-15 16:12:07,887 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689437464006_0004_000001 (auth:SIMPLE) 2023-07-15 16:12:10,120 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689437464006_0004_000001 (auth:SIMPLE) 2023-07-15 16:12:15,665 INFO [Listener at jenkins-hbase4.apache.org/42699] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-15 16:12:15,697 INFO [Listener at jenkins-hbase4.apache.org/42699] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-15 16:12:15,701 INFO [Listener at jenkins-hbase4.apache.org/42699] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-15 16:12:15,701 INFO [Listener at jenkins-hbase4.apache.org/42699] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-15 16:12:15,701 INFO [Listener at jenkins-hbase4.apache.org/42699] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-15 16:12:15,701 DEBUG [Listener at jenkins-hbase4.apache.org/42699] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-127961896_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-15 16:12:15,706 DEBUG [Listener at jenkins-hbase4.apache.org/42699] snapshot.TestExportSnapshot(367): hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-15 16:12:15,706 DEBUG [Listener at jenkins-hbase4.apache.org/42699] snapshot.TestExportSnapshot(367): hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-15 16:12:15,706 DEBUG [Listener at jenkins-hbase4.apache.org/42699] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@658c0b in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1587f29c-5daf-234a-1773-5088522b715e/local-export-1689437504306/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1587f29c-5daf-234a-1773-5088522b715e/local-export-1689437504306/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-15 16:12:15,707 DEBUG [Listener at jenkins-hbase4.apache.org/42699] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1587f29c-5daf-234a-1773-5088522b715e/local-export-1689437504306/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-15 16:12:15,707 DEBUG [Listener at jenkins-hbase4.apache.org/42699] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1587f29c-5daf-234a-1773-5088522b715e/local-export-1689437504306/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-15 16:12:15,720 INFO [Listener at jenkins-hbase4.apache.org/42699] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-07-15 16:12:15,721 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-07-15 16:12:15,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] procedure2.ProcedureExecutor(1029): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-07-15 16:12:15,725 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-15 16:12:15,725 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689437535725"}]},"ts":"1689437535725"} 2023-07-15 16:12:15,727 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-07-15 16:12:15,765 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-07-15 16:12:15,766 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=909bb1560d27e98b016e0a15f2e6e5ff, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=72eac9e91762db39c5e36d093362e297, UNASSIGN}] 2023-07-15 16:12:15,769 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=909bb1560d27e98b016e0a15f2e6e5ff, UNASSIGN 2023-07-15 16:12:15,769 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=72eac9e91762db39c5e36d093362e297, UNASSIGN 2023-07-15 16:12:15,770 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=909bb1560d27e98b016e0a15f2e6e5ff, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:15,770 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=72eac9e91762db39c5e36d093362e297, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:12:15,770 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689437502142.909bb1560d27e98b016e0a15f2e6e5ff.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689437535770"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689437535770"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689437535770"}]},"ts":"1689437535770"} 2023-07-15 16:12:15,770 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689437502142.72eac9e91762db39c5e36d093362e297.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689437535770"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689437535770"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689437535770"}]},"ts":"1689437535770"} 2023-07-15 16:12:15,772 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=52, state=RUNNABLE; CloseRegionProcedure 909bb1560d27e98b016e0a15f2e6e5ff, server=jenkins-hbase4.apache.org,43103,1689437454905}] 2023-07-15 16:12:15,772 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=53, state=RUNNABLE; CloseRegionProcedure 72eac9e91762db39c5e36d093362e297, server=jenkins-hbase4.apache.org,35773,1689437454990}] 2023-07-15 16:12:15,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-15 16:12:15,925 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 909bb1560d27e98b016e0a15f2e6e5ff 2023-07-15 16:12:15,925 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 909bb1560d27e98b016e0a15f2e6e5ff, disabling compactions & flushes 2023-07-15 16:12:15,925 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 72eac9e91762db39c5e36d093362e297 2023-07-15 16:12:15,925 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689437502142.909bb1560d27e98b016e0a15f2e6e5ff. 2023-07-15 16:12:15,925 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689437502142.909bb1560d27e98b016e0a15f2e6e5ff. 2023-07-15 16:12:15,925 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 72eac9e91762db39c5e36d093362e297, disabling compactions & flushes 2023-07-15 16:12:15,926 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689437502142.909bb1560d27e98b016e0a15f2e6e5ff. after waiting 0 ms 2023-07-15 16:12:15,926 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689437502142.72eac9e91762db39c5e36d093362e297. 2023-07-15 16:12:15,926 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689437502142.909bb1560d27e98b016e0a15f2e6e5ff. 2023-07-15 16:12:15,926 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689437502142.72eac9e91762db39c5e36d093362e297. 2023-07-15 16:12:15,926 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689437502142.72eac9e91762db39c5e36d093362e297. after waiting 0 ms 2023-07-15 16:12:15,926 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689437502142.72eac9e91762db39c5e36d093362e297. 2023-07-15 16:12:15,952 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testConsecutiveExports/909bb1560d27e98b016e0a15f2e6e5ff/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 16:12:15,953 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 16:12:15,955 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689437502142.909bb1560d27e98b016e0a15f2e6e5ff. 2023-07-15 16:12:15,955 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 909bb1560d27e98b016e0a15f2e6e5ff: 2023-07-15 16:12:15,962 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testConsecutiveExports/72eac9e91762db39c5e36d093362e297/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 16:12:15,962 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 16:12:15,963 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689437502142.72eac9e91762db39c5e36d093362e297. 2023-07-15 16:12:15,964 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 72eac9e91762db39c5e36d093362e297: 2023-07-15 16:12:15,972 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 909bb1560d27e98b016e0a15f2e6e5ff 2023-07-15 16:12:15,973 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=909bb1560d27e98b016e0a15f2e6e5ff, regionState=CLOSED 2023-07-15 16:12:15,973 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689437502142.909bb1560d27e98b016e0a15f2e6e5ff.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689437535973"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689437535973"}]},"ts":"1689437535973"} 2023-07-15 16:12:15,974 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 72eac9e91762db39c5e36d093362e297 2023-07-15 16:12:15,974 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=72eac9e91762db39c5e36d093362e297, regionState=CLOSED 2023-07-15 16:12:15,974 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689437502142.72eac9e91762db39c5e36d093362e297.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689437535974"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689437535974"}]},"ts":"1689437535974"} 2023-07-15 16:12:15,978 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=52 2023-07-15 16:12:15,978 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=52, state=SUCCESS; CloseRegionProcedure 909bb1560d27e98b016e0a15f2e6e5ff, server=jenkins-hbase4.apache.org,43103,1689437454905 in 204 msec 2023-07-15 16:12:15,980 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=53 2023-07-15 16:12:15,980 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=53, state=SUCCESS; CloseRegionProcedure 72eac9e91762db39c5e36d093362e297, server=jenkins-hbase4.apache.org,35773,1689437454990 in 204 msec 2023-07-15 16:12:15,980 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=909bb1560d27e98b016e0a15f2e6e5ff, UNASSIGN in 212 msec 2023-07-15 16:12:15,982 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=51 2023-07-15 16:12:15,982 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=72eac9e91762db39c5e36d093362e297, UNASSIGN in 214 msec 2023-07-15 16:12:15,982 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689437535982"}]},"ts":"1689437535982"} 2023-07-15 16:12:15,986 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-07-15 16:12:16,019 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-07-15 16:12:16,027 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 299 msec 2023-07-15 16:12:16,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-15 16:12:16,028 INFO [Listener at jenkins-hbase4.apache.org/42699] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-07-15 16:12:16,029 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-07-15 16:12:16,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] procedure2.ProcedureExecutor(1029): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-15 16:12:16,033 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-15 16:12:16,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-07-15 16:12:16,035 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-15 16:12:16,071 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43103] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-07-15 16:12:16,075 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testConsecutiveExports/909bb1560d27e98b016e0a15f2e6e5ff 2023-07-15 16:12:16,077 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testConsecutiveExports/72eac9e91762db39c5e36d093362e297 2023-07-15 16:12:16,079 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testConsecutiveExports/909bb1560d27e98b016e0a15f2e6e5ff/cf, FileablePath, hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testConsecutiveExports/909bb1560d27e98b016e0a15f2e6e5ff/recovered.edits] 2023-07-15 16:12:16,080 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testConsecutiveExports/72eac9e91762db39c5e36d093362e297/cf, FileablePath, hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testConsecutiveExports/72eac9e91762db39c5e36d093362e297/recovered.edits] 2023-07-15 16:12:16,087 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testConsecutiveExports/909bb1560d27e98b016e0a15f2e6e5ff/cf/a90208876b964acd80c3ea59dd7439a2 to hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/archive/data/default/testtb-testConsecutiveExports/909bb1560d27e98b016e0a15f2e6e5ff/cf/a90208876b964acd80c3ea59dd7439a2 2023-07-15 16:12:16,088 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testConsecutiveExports/72eac9e91762db39c5e36d093362e297/cf/0f9f4f95c2a1439096adb1de278b5fb8 to hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/archive/data/default/testtb-testConsecutiveExports/72eac9e91762db39c5e36d093362e297/cf/0f9f4f95c2a1439096adb1de278b5fb8 2023-07-15 16:12:16,092 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testConsecutiveExports/909bb1560d27e98b016e0a15f2e6e5ff/recovered.edits/9.seqid to hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/archive/data/default/testtb-testConsecutiveExports/909bb1560d27e98b016e0a15f2e6e5ff/recovered.edits/9.seqid 2023-07-15 16:12:16,093 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testConsecutiveExports/909bb1560d27e98b016e0a15f2e6e5ff 2023-07-15 16:12:16,096 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testConsecutiveExports/72eac9e91762db39c5e36d093362e297/recovered.edits/9.seqid to hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/archive/data/default/testtb-testConsecutiveExports/72eac9e91762db39c5e36d093362e297/recovered.edits/9.seqid 2023-07-15 16:12:16,096 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testConsecutiveExports/72eac9e91762db39c5e36d093362e297 2023-07-15 16:12:16,096 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-15 16:12:16,102 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-15 16:12:16,110 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-07-15 16:12:16,119 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-15 16:12:16,119 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-15 16:12:16,119 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-15 16:12:16,119 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-15 16:12:16,120 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-15 16:12:16,120 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-15 16:12:16,120 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-15 16:12:16,120 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-15 16:12:16,122 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-07-15 16:12:16,123 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-15 16:12:16,123 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-07-15 16:12:16,123 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1689437502142.909bb1560d27e98b016e0a15f2e6e5ff.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689437536123"}]},"ts":"9223372036854775807"} 2023-07-15 16:12:16,124 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1689437502142.72eac9e91762db39c5e36d093362e297.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689437536123"}]},"ts":"9223372036854775807"} 2023-07-15 16:12:16,126 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-15 16:12:16,126 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 909bb1560d27e98b016e0a15f2e6e5ff, NAME => 'testtb-testConsecutiveExports,,1689437502142.909bb1560d27e98b016e0a15f2e6e5ff.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 72eac9e91762db39c5e36d093362e297, NAME => 'testtb-testConsecutiveExports,1,1689437502142.72eac9e91762db39c5e36d093362e297.', STARTKEY => '1', ENDKEY => ''}] 2023-07-15 16:12:16,126 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-07-15 16:12:16,126 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689437536126"}]},"ts":"9223372036854775807"} 2023-07-15 16:12:16,142 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-15 16:12:16,142 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-15 16:12:16,142 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-15 16:12:16,142 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 16:12:16,142 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-15 16:12:16,142 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 16:12:16,142 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 16:12:16,142 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 16:12:16,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-15 16:12:16,161 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-07-15 16:12:16,197 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-15 16:12:16,198 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 168 msec 2023-07-15 16:12:16,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-15 16:12:16,245 INFO [Listener at jenkins-hbase4.apache.org/42699] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-07-15 16:12:16,254 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-07-15 16:12:16,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-07-15 16:12:16,257 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-07-15 16:12:16,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-07-15 16:12:16,286 INFO [Listener at jenkins-hbase4.apache.org/42699] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testConsecutiveExports Thread=747 (was 761), OpenFileDescriptor=887 (was 910), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=562 (was 409) - SystemLoadAverage LEAK? -, ProcessCount=185 (was 183) - ProcessCount LEAK? -, AvailableMemoryMB=2755 (was 3006) 2023-07-15 16:12:16,286 WARN [Listener at jenkins-hbase4.apache.org/42699] hbase.ResourceChecker(130): Thread=747 is superior to 500 2023-07-15 16:12:16,306 INFO [Listener at jenkins-hbase4.apache.org/42699] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=747, OpenFileDescriptor=887, MaxFileDescriptor=60000, SystemLoadAverage=562, ProcessCount=185, AvailableMemoryMB=2754 2023-07-15 16:12:16,307 WARN [Listener at jenkins-hbase4.apache.org/42699] hbase.ResourceChecker(130): Thread=747 is superior to 500 2023-07-15 16:12:16,308 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-15 16:12:16,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] procedure2.ProcedureExecutor(1029): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:16,312 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-07-15 16:12:16,312 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-07-15 16:12:16,312 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-15 16:12:16,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-15 16:12:16,315 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/88c6238f8097f3ef1058d488881fd8e7 2023-07-15 16:12:16,315 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9b7c5797a4ac81296849f2c2fa5aa9e1 2023-07-15 16:12:16,316 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9b7c5797a4ac81296849f2c2fa5aa9e1 empty. 2023-07-15 16:12:16,316 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/88c6238f8097f3ef1058d488881fd8e7 empty. 2023-07-15 16:12:16,316 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9b7c5797a4ac81296849f2c2fa5aa9e1 2023-07-15 16:12:16,316 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/88c6238f8097f3ef1058d488881fd8e7 2023-07-15 16:12:16,316 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-15 16:12:16,340 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-07-15 16:12:16,343 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => 88c6238f8097f3ef1058d488881fd8e7, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689437536308.88c6238f8097f3ef1058d488881fd8e7.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp 2023-07-15 16:12:16,343 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 9b7c5797a4ac81296849f2c2fa5aa9e1, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689437536308.9b7c5797a4ac81296849f2c2fa5aa9e1.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp 2023-07-15 16:12:16,408 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689437536308.88c6238f8097f3ef1058d488881fd8e7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 16:12:16,408 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing 88c6238f8097f3ef1058d488881fd8e7, disabling compactions & flushes 2023-07-15 16:12:16,408 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689437536308.88c6238f8097f3ef1058d488881fd8e7. 2023-07-15 16:12:16,408 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689437536308.88c6238f8097f3ef1058d488881fd8e7. 2023-07-15 16:12:16,408 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689437536308.88c6238f8097f3ef1058d488881fd8e7. after waiting 0 ms 2023-07-15 16:12:16,408 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689437536308.88c6238f8097f3ef1058d488881fd8e7. 2023-07-15 16:12:16,408 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689437536308.88c6238f8097f3ef1058d488881fd8e7. 2023-07-15 16:12:16,408 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for 88c6238f8097f3ef1058d488881fd8e7: 2023-07-15 16:12:16,411 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689437536308.9b7c5797a4ac81296849f2c2fa5aa9e1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 16:12:16,411 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 9b7c5797a4ac81296849f2c2fa5aa9e1, disabling compactions & flushes 2023-07-15 16:12:16,411 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689437536308.9b7c5797a4ac81296849f2c2fa5aa9e1. 2023-07-15 16:12:16,411 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689437536308.9b7c5797a4ac81296849f2c2fa5aa9e1. 2023-07-15 16:12:16,411 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689437536308.9b7c5797a4ac81296849f2c2fa5aa9e1. after waiting 0 ms 2023-07-15 16:12:16,411 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689437536308.9b7c5797a4ac81296849f2c2fa5aa9e1. 2023-07-15 16:12:16,411 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689437536308.9b7c5797a4ac81296849f2c2fa5aa9e1. 2023-07-15 16:12:16,411 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 9b7c5797a4ac81296849f2c2fa5aa9e1: 2023-07-15 16:12:16,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-15 16:12:16,444 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-07-15 16:12:16,445 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689437536308.88c6238f8097f3ef1058d488881fd8e7.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689437536445"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689437536445"}]},"ts":"1689437536445"} 2023-07-15 16:12:16,445 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689437536308.9b7c5797a4ac81296849f2c2fa5aa9e1.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689437536445"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689437536445"}]},"ts":"1689437536445"} 2023-07-15 16:12:16,459 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-15 16:12:16,460 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-15 16:12:16,461 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689437536461"}]},"ts":"1689437536461"} 2023-07-15 16:12:16,462 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-07-15 16:12:16,534 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-15 16:12:16,536 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-15 16:12:16,536 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-15 16:12:16,536 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-15 16:12:16,536 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-15 16:12:16,536 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=88c6238f8097f3ef1058d488881fd8e7, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=9b7c5797a4ac81296849f2c2fa5aa9e1, ASSIGN}] 2023-07-15 16:12:16,553 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=88c6238f8097f3ef1058d488881fd8e7, ASSIGN 2023-07-15 16:12:16,554 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=9b7c5797a4ac81296849f2c2fa5aa9e1, ASSIGN 2023-07-15 16:12:16,572 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=9b7c5797a4ac81296849f2c2fa5aa9e1, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45149,1689437455062; forceNewPlan=false, retain=false 2023-07-15 16:12:16,572 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=88c6238f8097f3ef1058d488881fd8e7, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43103,1689437454905; forceNewPlan=false, retain=false 2023-07-15 16:12:16,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-15 16:12:16,723 INFO [jenkins-hbase4:37255] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-15 16:12:16,725 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=88c6238f8097f3ef1058d488881fd8e7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:16,725 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=9b7c5797a4ac81296849f2c2fa5aa9e1, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:16,725 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689437536308.88c6238f8097f3ef1058d488881fd8e7.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689437536725"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689437536725"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689437536725"}]},"ts":"1689437536725"} 2023-07-15 16:12:16,726 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689437536308.9b7c5797a4ac81296849f2c2fa5aa9e1.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689437536725"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689437536725"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689437536725"}]},"ts":"1689437536725"} 2023-07-15 16:12:16,727 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=58, state=RUNNABLE; OpenRegionProcedure 88c6238f8097f3ef1058d488881fd8e7, server=jenkins-hbase4.apache.org,43103,1689437454905}] 2023-07-15 16:12:16,728 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=59, state=RUNNABLE; OpenRegionProcedure 9b7c5797a4ac81296849f2c2fa5aa9e1, server=jenkins-hbase4.apache.org,45149,1689437455062}] 2023-07-15 16:12:16,885 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1689437536308.88c6238f8097f3ef1058d488881fd8e7. 2023-07-15 16:12:16,885 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 88c6238f8097f3ef1058d488881fd8e7, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689437536308.88c6238f8097f3ef1058d488881fd8e7.', STARTKEY => '', ENDKEY => '1'} 2023-07-15 16:12:16,885 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1689437536308.88c6238f8097f3ef1058d488881fd8e7. service=AccessControlService 2023-07-15 16:12:16,886 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 16:12:16,886 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 88c6238f8097f3ef1058d488881fd8e7 2023-07-15 16:12:16,886 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689437536308.88c6238f8097f3ef1058d488881fd8e7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 16:12:16,886 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 88c6238f8097f3ef1058d488881fd8e7 2023-07-15 16:12:16,886 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 88c6238f8097f3ef1058d488881fd8e7 2023-07-15 16:12:16,886 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1689437536308.9b7c5797a4ac81296849f2c2fa5aa9e1. 2023-07-15 16:12:16,886 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9b7c5797a4ac81296849f2c2fa5aa9e1, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689437536308.9b7c5797a4ac81296849f2c2fa5aa9e1.', STARTKEY => '1', ENDKEY => ''} 2023-07-15 16:12:16,887 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1689437536308.9b7c5797a4ac81296849f2c2fa5aa9e1. service=AccessControlService 2023-07-15 16:12:16,887 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 16:12:16,887 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 9b7c5797a4ac81296849f2c2fa5aa9e1 2023-07-15 16:12:16,887 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689437536308.9b7c5797a4ac81296849f2c2fa5aa9e1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 16:12:16,887 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 9b7c5797a4ac81296849f2c2fa5aa9e1 2023-07-15 16:12:16,887 INFO [StoreOpener-88c6238f8097f3ef1058d488881fd8e7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 88c6238f8097f3ef1058d488881fd8e7 2023-07-15 16:12:16,887 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 9b7c5797a4ac81296849f2c2fa5aa9e1 2023-07-15 16:12:16,888 INFO [StoreOpener-9b7c5797a4ac81296849f2c2fa5aa9e1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 9b7c5797a4ac81296849f2c2fa5aa9e1 2023-07-15 16:12:16,889 DEBUG [StoreOpener-88c6238f8097f3ef1058d488881fd8e7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportFileSystemStateWithMergeRegion/88c6238f8097f3ef1058d488881fd8e7/cf 2023-07-15 16:12:16,889 DEBUG [StoreOpener-88c6238f8097f3ef1058d488881fd8e7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportFileSystemStateWithMergeRegion/88c6238f8097f3ef1058d488881fd8e7/cf 2023-07-15 16:12:16,890 DEBUG [StoreOpener-9b7c5797a4ac81296849f2c2fa5aa9e1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportFileSystemStateWithMergeRegion/9b7c5797a4ac81296849f2c2fa5aa9e1/cf 2023-07-15 16:12:16,890 DEBUG [StoreOpener-9b7c5797a4ac81296849f2c2fa5aa9e1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportFileSystemStateWithMergeRegion/9b7c5797a4ac81296849f2c2fa5aa9e1/cf 2023-07-15 16:12:16,890 INFO [StoreOpener-88c6238f8097f3ef1058d488881fd8e7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 88c6238f8097f3ef1058d488881fd8e7 columnFamilyName cf 2023-07-15 16:12:16,891 INFO [StoreOpener-9b7c5797a4ac81296849f2c2fa5aa9e1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9b7c5797a4ac81296849f2c2fa5aa9e1 columnFamilyName cf 2023-07-15 16:12:16,891 INFO [StoreOpener-88c6238f8097f3ef1058d488881fd8e7-1] regionserver.HStore(310): Store=88c6238f8097f3ef1058d488881fd8e7/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 16:12:16,891 INFO [StoreOpener-9b7c5797a4ac81296849f2c2fa5aa9e1-1] regionserver.HStore(310): Store=9b7c5797a4ac81296849f2c2fa5aa9e1/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 16:12:16,895 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportFileSystemStateWithMergeRegion/88c6238f8097f3ef1058d488881fd8e7 2023-07-15 16:12:16,895 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportFileSystemStateWithMergeRegion/9b7c5797a4ac81296849f2c2fa5aa9e1 2023-07-15 16:12:16,895 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportFileSystemStateWithMergeRegion/88c6238f8097f3ef1058d488881fd8e7 2023-07-15 16:12:16,895 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportFileSystemStateWithMergeRegion/9b7c5797a4ac81296849f2c2fa5aa9e1 2023-07-15 16:12:16,899 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 88c6238f8097f3ef1058d488881fd8e7 2023-07-15 16:12:16,899 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 9b7c5797a4ac81296849f2c2fa5aa9e1 2023-07-15 16:12:16,901 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportFileSystemStateWithMergeRegion/9b7c5797a4ac81296849f2c2fa5aa9e1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 16:12:16,901 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportFileSystemStateWithMergeRegion/88c6238f8097f3ef1058d488881fd8e7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 16:12:16,902 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 9b7c5797a4ac81296849f2c2fa5aa9e1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59390558, jitterRate=-0.11501172184944153}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 16:12:16,902 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 9b7c5797a4ac81296849f2c2fa5aa9e1: 2023-07-15 16:12:16,902 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 88c6238f8097f3ef1058d488881fd8e7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73582942, jitterRate=0.09647127985954285}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 16:12:16,902 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 88c6238f8097f3ef1058d488881fd8e7: 2023-07-15 16:12:16,903 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1689437536308.88c6238f8097f3ef1058d488881fd8e7., pid=60, masterSystemTime=1689437536879 2023-07-15 16:12:16,903 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1689437536308.9b7c5797a4ac81296849f2c2fa5aa9e1., pid=61, masterSystemTime=1689437536880 2023-07-15 16:12:16,905 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1689437536308.9b7c5797a4ac81296849f2c2fa5aa9e1. 2023-07-15 16:12:16,905 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1689437536308.9b7c5797a4ac81296849f2c2fa5aa9e1. 2023-07-15 16:12:16,905 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=9b7c5797a4ac81296849f2c2fa5aa9e1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:16,905 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689437536308.9b7c5797a4ac81296849f2c2fa5aa9e1.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689437536905"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689437536905"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689437536905"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689437536905"}]},"ts":"1689437536905"} 2023-07-15 16:12:16,906 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1689437536308.88c6238f8097f3ef1058d488881fd8e7. 2023-07-15 16:12:16,906 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1689437536308.88c6238f8097f3ef1058d488881fd8e7. 2023-07-15 16:12:16,907 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=88c6238f8097f3ef1058d488881fd8e7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:16,907 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689437536308.88c6238f8097f3ef1058d488881fd8e7.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689437536907"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689437536907"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689437536907"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689437536907"}]},"ts":"1689437536907"} 2023-07-15 16:12:16,910 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=59 2023-07-15 16:12:16,910 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=59, state=SUCCESS; OpenRegionProcedure 9b7c5797a4ac81296849f2c2fa5aa9e1, server=jenkins-hbase4.apache.org,45149,1689437455062 in 180 msec 2023-07-15 16:12:16,911 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=58 2023-07-15 16:12:16,911 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=58, state=SUCCESS; OpenRegionProcedure 88c6238f8097f3ef1058d488881fd8e7, server=jenkins-hbase4.apache.org,43103,1689437454905 in 182 msec 2023-07-15 16:12:16,912 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=9b7c5797a4ac81296849f2c2fa5aa9e1, ASSIGN in 374 msec 2023-07-15 16:12:16,913 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=58, resume processing ppid=57 2023-07-15 16:12:16,913 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=88c6238f8097f3ef1058d488881fd8e7, ASSIGN in 375 msec 2023-07-15 16:12:16,914 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-15 16:12:16,914 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689437536914"}]},"ts":"1689437536914"} 2023-07-15 16:12:16,915 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-07-15 16:12:16,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-15 16:12:16,951 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-07-15 16:12:16,951 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-07-15 16:12:16,953 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43103] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-15 16:12:16,982 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 16:12:16,982 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 16:12:16,982 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 16:12:16,982 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 16:12:17,058 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-15 16:12:17,058 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-15 16:12:17,058 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-15 16:12:17,058 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-15 16:12:17,060 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 749 msec 2023-07-15 16:12:17,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-15 16:12:17,421 INFO [Listener at jenkins-hbase4.apache.org/42699] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-07-15 16:12:17,421 DEBUG [Listener at jenkins-hbase4.apache.org/42699] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemStateWithMergeRegion get assigned. Timeout = 60000ms 2023-07-15 16:12:17,421 INFO [Listener at jenkins-hbase4.apache.org/42699] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 16:12:17,425 INFO [Listener at jenkins-hbase4.apache.org/42699] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemStateWithMergeRegion assigned to meta. Checking AM states. 2023-07-15 16:12:17,425 INFO [Listener at jenkins-hbase4.apache.org/42699] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 16:12:17,425 INFO [Listener at jenkins-hbase4.apache.org/42699] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemStateWithMergeRegion assigned. 2023-07-15 16:12:17,428 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-15 16:12:17,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689437537428 (current time:1689437537428). 2023-07-15 16:12:17,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 16:12:17,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] zookeeper.ReadOnlyZKClient(139): Connect 0x062c8444 to 127.0.0.1:58438 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 16:12:17,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@65468d80, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 16:12:17,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 16:12:17,438 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60306, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 16:12:17,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x062c8444 to 127.0.0.1:58438 2023-07-15 16:12:17,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 16:12:17,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] zookeeper.ReadOnlyZKClient(139): Connect 0x306ed38c to 127.0.0.1:58438 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 16:12:17,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@52826f61, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 16:12:17,446 DEBUG [hconnection-0x379c23c-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 16:12:17,449 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60322, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 16:12:17,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x306ed38c to 127.0.0.1:58438 2023-07-15 16:12:17,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 16:12:17,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-15 16:12:17,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 16:12:17,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-15 16:12:17,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-15 16:12:17,457 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-15 16:12:17,458 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689438137458 2023-07-15 16:12:17,458 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:17,458 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-15 16:12:17,459 DEBUG [Listener at jenkins-hbase4.apache.org/42699] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 16:12:17,459 DEBUG [Listener at jenkins-hbase4.apache.org/42699] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 16:12:17,460 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-15 16:12:17,460 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-15 16:12:17,462 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 5 msec 2023-07-15 16:12:17,462 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-15 16:12:17,463 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689438137463 2023-07-15 16:12:17,477 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:17,477 INFO [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-15 16:12:17,477 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 16:12:17,479 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-15 16:12:17,479 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-15 16:12:17,480 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:17,480 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:17,481 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:12:17,481 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:17,481 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:12:17,481 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:12:17,481 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:12:17,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:12:17,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:12:17,482 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:17,482 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:17,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:17,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:17,482 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:17,482 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 16:12:17,482 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:17,483 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:17,483 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:12:17,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-15 16:12:17,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:17,483 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:12:17,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-15 16:12:17,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:17,483 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-15 16:12:17,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:12:17,483 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-15 16:12:17,483 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:17,484 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-15 16:12:17,484 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 16:12:17,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:17,484 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:17,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-15 16:12:17,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:17,485 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-15 16:12:17,490 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:17,492 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:17,492 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-15 16:12:17,493 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-15 16:12:17,493 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-15 16:12:17,493 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45149,1689437455062' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-15 16:12:17,493 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-15 16:12:17,493 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 16:12:17,493 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 16:12:17,494 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-15 16:12:17,494 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-15 16:12:17,494 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-15 16:12:17,495 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-15 16:12:17,494 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43103,1689437454905' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-15 16:12:17,495 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35773,1689437454990' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-15 16:12:17,496 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:17,496 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:17,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:17,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:12:17,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:12:17,497 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:17,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:12:17,497 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:17,497 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:17,497 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 16:12:17,497 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:17,498 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:17,498 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 16:12:17,498 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:17,498 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 16:12:17,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:12:17,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:17,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:17,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:12:17,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:17,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:12:17,501 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45149,1689437455062' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-15 16:12:17,501 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2b8088c9[Count = 1] remaining members to acquire global barrier 2023-07-15 16:12:17,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:17,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:12:17,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:12:17,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:12:17,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:12:17,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:17,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:17,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:12:17,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:17,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:12:17,507 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43103,1689437454905' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-15 16:12:17,507 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2b8088c9[Count = 0] remaining members to acquire global barrier 2023-07-15 16:12:17,507 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-15 16:12:17,507 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:17,509 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:17,509 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:17,509 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:17,509 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:17,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:17,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:17,509 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:17,510 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-15 16:12:17,510 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-15 16:12:17,510 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,35773,1689437454990' in zk 2023-07-15 16:12:17,510 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:17,509 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-15 16:12:17,510 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:17,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:17,510 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-15 16:12:17,510 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:17,511 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 16:12:17,511 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 16:12:17,511 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 16:12:17,511 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 16:12:17,511 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 16:12:17,511 DEBUG [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689437536308.88c6238f8097f3ef1058d488881fd8e7. 2023-07-15 16:12:17,511 DEBUG [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689437536308.88c6238f8097f3ef1058d488881fd8e7. started... 2023-07-15 16:12:17,511 DEBUG [rs(jenkins-hbase4.apache.org,45149,1689437455062)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689437536308.9b7c5797a4ac81296849f2c2fa5aa9e1. 2023-07-15 16:12:17,511 DEBUG [rs(jenkins-hbase4.apache.org,45149,1689437455062)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689437536308.9b7c5797a4ac81296849f2c2fa5aa9e1. started... 2023-07-15 16:12:17,515 DEBUG [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 88c6238f8097f3ef1058d488881fd8e7: 2023-07-15 16:12:17,515 DEBUG [rs(jenkins-hbase4.apache.org,45149,1689437455062)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9b7c5797a4ac81296849f2c2fa5aa9e1: 2023-07-15 16:12:17,515 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-15 16:12:17,515 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 16:12:17,515 DEBUG [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689437536308.88c6238f8097f3ef1058d488881fd8e7.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:17,515 DEBUG [rs(jenkins-hbase4.apache.org,45149,1689437455062)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689437536308.9b7c5797a4ac81296849f2c2fa5aa9e1.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:17,515 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-15 16:12:17,517 DEBUG [rs(jenkins-hbase4.apache.org,45149,1689437455062)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 16:12:17,517 DEBUG [rs(jenkins-hbase4.apache.org,45149,1689437455062)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-15 16:12:17,516 DEBUG [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 16:12:17,517 DEBUG [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-15 16:12:17,560 DEBUG [Listener at jenkins-hbase4.apache.org/42699] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 16:12:17,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-15 16:12:17,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-15 16:12:17,562 DEBUG [Listener at jenkins-hbase4.apache.org/42699] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 16:12:17,563 DEBUG [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689437536308.88c6238f8097f3ef1058d488881fd8e7. completed. 2023-07-15 16:12:17,563 DEBUG [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689437536308.88c6238f8097f3ef1058d488881fd8e7. 2023-07-15 16:12:17,563 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 16:12:17,563 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 16:12:17,563 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:17,566 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-15 16:12:17,567 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,43103,1689437454905' in zk 2023-07-15 16:12:17,568 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-15 16:12:17,568 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:17,568 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 16:12:17,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:17,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:12:17,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:12:17,568 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-15 16:12:17,575 DEBUG [rs(jenkins-hbase4.apache.org,45149,1689437455062)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689437536308.9b7c5797a4ac81296849f2c2fa5aa9e1. completed. 2023-07-15 16:12:17,575 DEBUG [rs(jenkins-hbase4.apache.org,45149,1689437455062)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689437536308.9b7c5797a4ac81296849f2c2fa5aa9e1. 2023-07-15 16:12:17,576 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 16:12:17,576 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 16:12:17,576 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:17,576 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-15 16:12:17,576 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,45149,1689437455062' in zk 2023-07-15 16:12:17,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:12:17,581 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-15 16:12:17,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:12:17,581 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:17,581 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 16:12:17,581 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-15 16:12:17,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:17,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:17,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:12:17,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:17,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:12:17,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:17,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:12:17,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:17,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:17,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,43103,1689437454905': 2023-07-15 16:12:17,585 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43103,1689437454905' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-15 16:12:17,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:17,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:12:17,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:12:17,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:12:17,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:12:17,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:17,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:17,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:12:17,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:17,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:12:17,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:17,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:12:17,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:17,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:17,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,45149,1689437455062': 2023-07-15 16:12:17,589 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45149,1689437455062' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-15 16:12:17,589 INFO [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-15 16:12:17,589 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 16:12:17,589 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 16:12:17,589 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:17,589 INFO [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 16:12:17,592 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:17,592 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:17,592 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:17,592 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:17,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:17,592 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:17,592 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:12:17,592 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:12:17,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:17,592 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:17,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:17,592 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:12:17,593 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:17,593 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:12:17,593 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:12:17,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:12:17,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:12:17,593 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:12:17,593 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:12:17,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:12:17,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:17,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:17,594 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:17,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:17,596 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:12:17,596 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:17,597 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:17,597 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:17,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:17,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:12:17,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:12:17,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:12:17,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:17,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:12:17,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:17,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:17,600 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:17,600 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:12:17,600 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:12:17,600 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:12:17,600 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:17,600 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:12:17,600 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 16:12:17,600 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:12:17,600 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:12:17,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:12:17,602 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:12:17,602 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:12:17,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:17,602 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:12:17,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:12:17,600 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:17,603 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:17,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:12:17,603 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:12:17,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:12:17,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:12:17,600 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:12:17,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:12:17,603 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:17,603 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:17,603 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:17,603 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:17,603 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:17,603 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:12:17,603 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:17,603 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:17,603 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:17,604 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:12:17,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:12:17,604 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:12:17,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:12:17,604 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion because node does not exist (not an error) 2023-07-15 16:12:17,669 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:17,751 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-15 16:12:17,752 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:17,752 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:17,752 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689437537458Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689437537603 (+145 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689437537603Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689437537636 (+33 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689437537658 (+22 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689437537751 (+93 ms) 2023-07-15 16:12:17,755 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-15 16:12:17,757 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 296 msec 2023-07-15 16:12:17,762 DEBUG [Listener at jenkins-hbase4.apache.org/42699] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 16:12:17,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-15 16:12:17,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 16:12:17,785 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45149] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1689437536308.9b7c5797a4ac81296849f2c2fa5aa9e1. with WAL disabled. Data may be lost in the event of a crash. 2023-07-15 16:12:17,792 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43103] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1689437536308.88c6238f8097f3ef1058d488881fd8e7. with WAL disabled. Data may be lost in the event of a crash. 2023-07-15 16:12:17,795 DEBUG [Listener at jenkins-hbase4.apache.org/42699] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:17,795 DEBUG [Listener at jenkins-hbase4.apache.org/42699] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689437536308.88c6238f8097f3ef1058d488881fd8e7. 2023-07-15 16:12:17,795 INFO [Listener at jenkins-hbase4.apache.org/42699] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 16:12:17,814 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-15 16:12:17,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689437537814 (current time:1689437537814). 2023-07-15 16:12:17,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 16:12:17,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] zookeeper.ReadOnlyZKClient(139): Connect 0x26e88f4f to 127.0.0.1:58438 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 16:12:17,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@423383e2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 16:12:17,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 16:12:17,834 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60334, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 16:12:17,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x26e88f4f to 127.0.0.1:58438 2023-07-15 16:12:17,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 16:12:17,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] zookeeper.ReadOnlyZKClient(139): Connect 0x4754aa7c to 127.0.0.1:58438 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 16:12:17,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2524c72e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 16:12:17,845 DEBUG [hconnection-0x7b566cfb-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 16:12:17,848 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60350, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 16:12:17,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4754aa7c to 127.0.0.1:58438 2023-07-15 16:12:17,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 16:12:17,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-15 16:12:17,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 16:12:17,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-15 16:12:17,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-15 16:12:17,858 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-15 16:12:17,858 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689438137858 2023-07-15 16:12:17,858 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:17,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-15 16:12:17,860 DEBUG [Listener at jenkins-hbase4.apache.org/42699] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 16:12:17,860 DEBUG [Listener at jenkins-hbase4.apache.org/42699] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 16:12:17,862 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-15 16:12:17,861 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-15 16:12:17,863 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 6 msec 2023-07-15 16:12:17,864 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-15 16:12:17,865 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689438137865 2023-07-15 16:12:17,893 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:17,893 INFO [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-15 16:12:17,893 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 16:12:17,895 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-15 16:12:17,895 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-15 16:12:17,895 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:17,895 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:17,897 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:12:17,897 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:12:17,897 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:17,897 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:12:17,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:12:17,897 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:12:17,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:12:17,897 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:12:17,897 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:12:17,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:12:17,897 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:17,897 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:17,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:17,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:17,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:17,898 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:17,898 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:17,898 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:17,898 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 16:12:17,898 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:17,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-15 16:12:17,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:17,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-15 16:12:17,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:17,898 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-15 16:12:17,898 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-15 16:12:17,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-15 16:12:17,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:17,899 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:17,899 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-15 16:12:17,899 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-15 16:12:17,899 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:17,899 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:17,899 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-15 16:12:17,899 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-15 16:12:17,899 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 16:12:17,899 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 16:12:17,900 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-15 16:12:17,901 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-15 16:12:17,899 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 16:12:17,901 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43103,1689437454905' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-15 16:12:17,902 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-15 16:12:17,902 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-15 16:12:17,902 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35773,1689437454990' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-15 16:12:17,901 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-15 16:12:17,902 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-15 16:12:17,902 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45149,1689437455062' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-15 16:12:17,904 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:17,904 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:17,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:17,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:12:17,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:12:17,905 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:17,905 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:17,905 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:17,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:12:17,905 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:17,905 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 16:12:17,905 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:17,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:12:17,905 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 16:12:17,906 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:17,906 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 16:12:17,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:17,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:12:17,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:17,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:17,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:12:17,907 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43103,1689437454905' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-15 16:12:17,907 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@556b1474[Count = 1] remaining members to acquire global barrier 2023-07-15 16:12:17,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:17,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:12:17,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:12:17,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:12:17,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:12:17,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:17,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:12:17,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:17,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:17,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:12:17,910 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45149,1689437455062' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-15 16:12:17,910 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@556b1474[Count = 0] remaining members to acquire global barrier 2023-07-15 16:12:17,910 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-15 16:12:17,910 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:17,911 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:17,911 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:17,911 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:17,911 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:17,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:17,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:17,911 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-15 16:12:17,911 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-15 16:12:17,911 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:17,911 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:17,911 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 16:12:17,911 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 16:12:17,911 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-15 16:12:17,911 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,35773,1689437454990' in zk 2023-07-15 16:12:17,911 DEBUG [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689437536308.88c6238f8097f3ef1058d488881fd8e7. 2023-07-15 16:12:17,912 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:17,912 DEBUG [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689437536308.88c6238f8097f3ef1058d488881fd8e7. started... 2023-07-15 16:12:17,911 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:17,912 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 16:12:17,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:17,912 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-15 16:12:17,912 INFO [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 88c6238f8097f3ef1058d488881fd8e7 1/1 column families, dataSize=400 B heapSize=1.09 KB 2023-07-15 16:12:17,912 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 16:12:17,912 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 16:12:17,912 DEBUG [rs(jenkins-hbase4.apache.org,45149,1689437455062)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689437536308.9b7c5797a4ac81296849f2c2fa5aa9e1. 2023-07-15 16:12:17,912 DEBUG [rs(jenkins-hbase4.apache.org,45149,1689437455062)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689437536308.9b7c5797a4ac81296849f2c2fa5aa9e1. started... 2023-07-15 16:12:17,912 INFO [rs(jenkins-hbase4.apache.org,45149,1689437455062)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 9b7c5797a4ac81296849f2c2fa5aa9e1 1/1 column families, dataSize=2.87 KB heapSize=6.44 KB 2023-07-15 16:12:17,913 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-15 16:12:17,913 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 16:12:17,913 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-15 16:12:17,939 INFO [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=400 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportFileSystemStateWithMergeRegion/88c6238f8097f3ef1058d488881fd8e7/.tmp/cf/b497f3f474be4a1bb1aa59ca3821962d 2023-07-15 16:12:17,945 INFO [rs(jenkins-hbase4.apache.org,45149,1689437455062)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.87 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportFileSystemStateWithMergeRegion/9b7c5797a4ac81296849f2c2fa5aa9e1/.tmp/cf/b86bd757fdf94e38ac5ef58761f3397b 2023-07-15 16:12:17,948 DEBUG [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportFileSystemStateWithMergeRegion/88c6238f8097f3ef1058d488881fd8e7/.tmp/cf/b497f3f474be4a1bb1aa59ca3821962d as hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportFileSystemStateWithMergeRegion/88c6238f8097f3ef1058d488881fd8e7/cf/b497f3f474be4a1bb1aa59ca3821962d 2023-07-15 16:12:17,951 DEBUG [rs(jenkins-hbase4.apache.org,45149,1689437455062)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportFileSystemStateWithMergeRegion/9b7c5797a4ac81296849f2c2fa5aa9e1/.tmp/cf/b86bd757fdf94e38ac5ef58761f3397b as hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportFileSystemStateWithMergeRegion/9b7c5797a4ac81296849f2c2fa5aa9e1/cf/b86bd757fdf94e38ac5ef58761f3397b 2023-07-15 16:12:17,953 INFO [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportFileSystemStateWithMergeRegion/88c6238f8097f3ef1058d488881fd8e7/cf/b497f3f474be4a1bb1aa59ca3821962d, entries=6, sequenceid=6, filesize=5.2 K 2023-07-15 16:12:17,954 INFO [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~400 B/400, heapSize ~1.08 KB/1104, currentSize=0 B/0 for 88c6238f8097f3ef1058d488881fd8e7 in 42ms, sequenceid=6, compaction requested=false 2023-07-15 16:12:17,954 DEBUG [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-15 16:12:17,954 DEBUG [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 88c6238f8097f3ef1058d488881fd8e7: 2023-07-15 16:12:17,954 DEBUG [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689437536308.88c6238f8097f3ef1058d488881fd8e7.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:17,954 DEBUG [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 16:12:17,954 DEBUG [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportFileSystemStateWithMergeRegion/88c6238f8097f3ef1058d488881fd8e7/cf/b497f3f474be4a1bb1aa59ca3821962d] hfiles 2023-07-15 16:12:17,955 DEBUG [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportFileSystemStateWithMergeRegion/88c6238f8097f3ef1058d488881fd8e7/cf/b497f3f474be4a1bb1aa59ca3821962d for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:17,957 INFO [rs(jenkins-hbase4.apache.org,45149,1689437455062)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportFileSystemStateWithMergeRegion/9b7c5797a4ac81296849f2c2fa5aa9e1/cf/b86bd757fdf94e38ac5ef58761f3397b, entries=44, sequenceid=6, filesize=7.8 K 2023-07-15 16:12:17,958 INFO [rs(jenkins-hbase4.apache.org,45149,1689437455062)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.87 KB/2936, heapSize ~6.42 KB/6576, currentSize=0 B/0 for 9b7c5797a4ac81296849f2c2fa5aa9e1 in 46ms, sequenceid=6, compaction requested=false 2023-07-15 16:12:17,960 DEBUG [rs(jenkins-hbase4.apache.org,45149,1689437455062)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9b7c5797a4ac81296849f2c2fa5aa9e1: 2023-07-15 16:12:17,961 DEBUG [rs(jenkins-hbase4.apache.org,45149,1689437455062)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689437536308.9b7c5797a4ac81296849f2c2fa5aa9e1.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:17,961 DEBUG [rs(jenkins-hbase4.apache.org,45149,1689437455062)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 16:12:17,961 DEBUG [rs(jenkins-hbase4.apache.org,45149,1689437455062)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportFileSystemStateWithMergeRegion/9b7c5797a4ac81296849f2c2fa5aa9e1/cf/b86bd757fdf94e38ac5ef58761f3397b] hfiles 2023-07-15 16:12:17,961 DEBUG [rs(jenkins-hbase4.apache.org,45149,1689437455062)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportFileSystemStateWithMergeRegion/9b7c5797a4ac81296849f2c2fa5aa9e1/cf/b86bd757fdf94e38ac5ef58761f3397b for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:17,962 DEBUG [Listener at jenkins-hbase4.apache.org/42699] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 16:12:17,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-15 16:12:17,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-15 16:12:17,963 DEBUG [Listener at jenkins-hbase4.apache.org/42699] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 16:12:17,975 DEBUG [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689437536308.88c6238f8097f3ef1058d488881fd8e7. completed. 2023-07-15 16:12:17,975 DEBUG [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689437536308.88c6238f8097f3ef1058d488881fd8e7. 2023-07-15 16:12:17,975 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 16:12:17,975 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 16:12:17,975 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:17,975 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-15 16:12:17,975 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,43103,1689437454905' in zk 2023-07-15 16:12:17,978 DEBUG [rs(jenkins-hbase4.apache.org,45149,1689437455062)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689437536308.9b7c5797a4ac81296849f2c2fa5aa9e1. completed. 2023-07-15 16:12:17,978 DEBUG [rs(jenkins-hbase4.apache.org,45149,1689437455062)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689437536308.9b7c5797a4ac81296849f2c2fa5aa9e1. 2023-07-15 16:12:17,978 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 16:12:17,979 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 16:12:17,979 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:17,979 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-15 16:12:17,979 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,45149,1689437455062' in zk 2023-07-15 16:12:17,982 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:17,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:17,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:12:17,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:12:17,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:12:17,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:12:17,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:17,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:12:17,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:17,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:17,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:12:17,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:17,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:12:17,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:17,985 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-15 16:12:17,985 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 16:12:17,986 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-15 16:12:17,988 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:17,988 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-15 16:12:17,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,43103,1689437454905': 2023-07-15 16:12:17,988 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 16:12:17,988 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43103,1689437454905' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-15 16:12:17,988 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-15 16:12:17,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:17,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:12:17,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:12:17,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:12:17,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:12:17,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:17,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:12:17,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:17,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:17,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:12:17,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:17,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:12:17,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:17,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:17,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,45149,1689437455062': 2023-07-15 16:12:17,994 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45149,1689437455062' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-15 16:12:17,994 INFO [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-15 16:12:17,994 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 16:12:17,994 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 16:12:17,994 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:17,994 INFO [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 16:12:18,002 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,002 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,002 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,002 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,002 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:12:18,002 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:12:18,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:12:18,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,002 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:12:18,002 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:12:18,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:12:18,002 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,003 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:12:18,003 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,003 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:12:18,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:12:18,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,003 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:12:18,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:12:18,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:12:18,008 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:12:18,008 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:18,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:12:18,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:12:18,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:18,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:18,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:12:18,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:12:18,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:18,012 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:18,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:18,015 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:12:18,015 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:18,015 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:18,018 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:12:18,018 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:18,018 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:12:18,018 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:12:18,018 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,018 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 16:12:18,018 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,018 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:12:18,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:12:18,018 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:12:18,018 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,018 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:12:18,018 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:12:18,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:12:18,020 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:18,020 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:12:18,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:12:18,018 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:12:18,018 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:12:18,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:12:18,020 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:12:18,020 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,020 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,020 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:18,020 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:12:18,021 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:12:18,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:12:18,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:12:18,021 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,021 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:18,021 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:12:18,021 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,021 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,036 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,054 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-15 16:12:18,054 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,054 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,055 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689437537859Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689437538018 (+159 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1689437538020 (+2 ms)Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1689437538023 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689437538030 (+7 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689437538054 (+24 ms) 2023-07-15 16:12:18,057 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-15 16:12:18,058 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 197 msec 2023-07-15 16:12:18,163 DEBUG [Listener at jenkins-hbase4.apache.org/42699] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 16:12:18,164 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-15 16:12:18,164 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 16:12:18,198 DEBUG [Listener at jenkins-hbase4.apache.org/42699] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-15 16:12:18,202 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46286, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-15 16:12:18,204 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35773] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-15 16:12:18,204 DEBUG [Listener at jenkins-hbase4.apache.org/42699] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-15 16:12:18,209 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60358, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-15 16:12:18,209 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43103] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-15 16:12:18,209 DEBUG [Listener at jenkins-hbase4.apache.org/42699] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-15 16:12:18,214 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34958, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-15 16:12:18,214 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45149] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-15 16:12:18,216 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-15 16:12:18,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] procedure2.ProcedureExecutor(1029): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:18,219 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-15 16:12:18,219 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-07-15 16:12:18,219 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-15 16:12:18,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-15 16:12:18,222 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4d6921d2bfbcfe124574a904c9eb4368 2023-07-15 16:12:18,222 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4ada3ddbee169b939dd4b09687100489 2023-07-15 16:12:18,223 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4d6921d2bfbcfe124574a904c9eb4368 empty. 2023-07-15 16:12:18,223 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4ada3ddbee169b939dd4b09687100489 empty. 2023-07-15 16:12:18,223 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4d6921d2bfbcfe124574a904c9eb4368 2023-07-15 16:12:18,223 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4ada3ddbee169b939dd4b09687100489 2023-07-15 16:12:18,223 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-15 16:12:18,233 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-07-15 16:12:18,234 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 4ada3ddbee169b939dd4b09687100489, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689437538216.4ada3ddbee169b939dd4b09687100489.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp 2023-07-15 16:12:18,234 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 4d6921d2bfbcfe124574a904c9eb4368, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689437538216.4d6921d2bfbcfe124574a904c9eb4368.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp 2023-07-15 16:12:18,247 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689437538216.4ada3ddbee169b939dd4b09687100489.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 16:12:18,247 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 4ada3ddbee169b939dd4b09687100489, disabling compactions & flushes 2023-07-15 16:12:18,248 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689437538216.4ada3ddbee169b939dd4b09687100489. 2023-07-15 16:12:18,248 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689437538216.4ada3ddbee169b939dd4b09687100489. 2023-07-15 16:12:18,248 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689437538216.4d6921d2bfbcfe124574a904c9eb4368.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 16:12:18,248 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689437538216.4ada3ddbee169b939dd4b09687100489. after waiting 0 ms 2023-07-15 16:12:18,248 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689437538216.4ada3ddbee169b939dd4b09687100489. 2023-07-15 16:12:18,248 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing 4d6921d2bfbcfe124574a904c9eb4368, disabling compactions & flushes 2023-07-15 16:12:18,248 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689437538216.4ada3ddbee169b939dd4b09687100489. 2023-07-15 16:12:18,248 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689437538216.4d6921d2bfbcfe124574a904c9eb4368. 2023-07-15 16:12:18,248 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 4ada3ddbee169b939dd4b09687100489: 2023-07-15 16:12:18,248 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689437538216.4d6921d2bfbcfe124574a904c9eb4368. 2023-07-15 16:12:18,248 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689437538216.4d6921d2bfbcfe124574a904c9eb4368. after waiting 0 ms 2023-07-15 16:12:18,248 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689437538216.4d6921d2bfbcfe124574a904c9eb4368. 2023-07-15 16:12:18,248 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689437538216.4d6921d2bfbcfe124574a904c9eb4368. 2023-07-15 16:12:18,248 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for 4d6921d2bfbcfe124574a904c9eb4368: 2023-07-15 16:12:18,250 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-07-15 16:12:18,251 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689437538216.4ada3ddbee169b939dd4b09687100489.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689437538251"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689437538251"}]},"ts":"1689437538251"} 2023-07-15 16:12:18,251 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689437538216.4d6921d2bfbcfe124574a904c9eb4368.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689437538251"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689437538251"}]},"ts":"1689437538251"} 2023-07-15 16:12:18,253 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-15 16:12:18,254 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-15 16:12:18,254 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689437538254"}]},"ts":"1689437538254"} 2023-07-15 16:12:18,255 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-07-15 16:12:18,259 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-15 16:12:18,260 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-15 16:12:18,260 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-15 16:12:18,260 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-15 16:12:18,260 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-15 16:12:18,260 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4d6921d2bfbcfe124574a904c9eb4368, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4ada3ddbee169b939dd4b09687100489, ASSIGN}] 2023-07-15 16:12:18,262 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4ada3ddbee169b939dd4b09687100489, ASSIGN 2023-07-15 16:12:18,262 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4d6921d2bfbcfe124574a904c9eb4368, ASSIGN 2023-07-15 16:12:18,263 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4ada3ddbee169b939dd4b09687100489, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45149,1689437455062; forceNewPlan=false, retain=false 2023-07-15 16:12:18,263 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4d6921d2bfbcfe124574a904c9eb4368, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35773,1689437454990; forceNewPlan=false, retain=false 2023-07-15 16:12:18,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-15 16:12:18,413 INFO [jenkins-hbase4:37255] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-15 16:12:18,416 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=4d6921d2bfbcfe124574a904c9eb4368, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:12:18,416 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689437538216.4d6921d2bfbcfe124574a904c9eb4368.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689437538416"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689437538416"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689437538416"}]},"ts":"1689437538416"} 2023-07-15 16:12:18,416 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=4ada3ddbee169b939dd4b09687100489, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:18,417 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689437538216.4ada3ddbee169b939dd4b09687100489.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689437538416"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689437538416"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689437538416"}]},"ts":"1689437538416"} 2023-07-15 16:12:18,419 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure 4d6921d2bfbcfe124574a904c9eb4368, server=jenkins-hbase4.apache.org,35773,1689437454990}] 2023-07-15 16:12:18,421 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=70, ppid=68, state=RUNNABLE; OpenRegionProcedure 4ada3ddbee169b939dd4b09687100489, server=jenkins-hbase4.apache.org,45149,1689437455062}] 2023-07-15 16:12:18,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-15 16:12:18,575 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689437538216.4d6921d2bfbcfe124574a904c9eb4368. 2023-07-15 16:12:18,575 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4d6921d2bfbcfe124574a904c9eb4368, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689437538216.4d6921d2bfbcfe124574a904c9eb4368.', STARTKEY => '', ENDKEY => '2'} 2023-07-15 16:12:18,576 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1689437538216.4ada3ddbee169b939dd4b09687100489. 2023-07-15 16:12:18,576 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4ada3ddbee169b939dd4b09687100489, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689437538216.4ada3ddbee169b939dd4b09687100489.', STARTKEY => '2', ENDKEY => ''} 2023-07-15 16:12:18,576 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689437538216.4d6921d2bfbcfe124574a904c9eb4368. service=AccessControlService 2023-07-15 16:12:18,576 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1689437538216.4ada3ddbee169b939dd4b09687100489. service=AccessControlService 2023-07-15 16:12:18,577 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 16:12:18,577 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 16:12:18,577 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 4d6921d2bfbcfe124574a904c9eb4368 2023-07-15 16:12:18,577 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 4ada3ddbee169b939dd4b09687100489 2023-07-15 16:12:18,577 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689437538216.4d6921d2bfbcfe124574a904c9eb4368.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 16:12:18,577 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689437538216.4ada3ddbee169b939dd4b09687100489.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 16:12:18,577 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 4d6921d2bfbcfe124574a904c9eb4368 2023-07-15 16:12:18,577 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 4ada3ddbee169b939dd4b09687100489 2023-07-15 16:12:18,577 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 4d6921d2bfbcfe124574a904c9eb4368 2023-07-15 16:12:18,577 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 4ada3ddbee169b939dd4b09687100489 2023-07-15 16:12:18,579 INFO [StoreOpener-4d6921d2bfbcfe124574a904c9eb4368-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 4d6921d2bfbcfe124574a904c9eb4368 2023-07-15 16:12:18,581 INFO [StoreOpener-4ada3ddbee169b939dd4b09687100489-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 4ada3ddbee169b939dd4b09687100489 2023-07-15 16:12:18,582 DEBUG [StoreOpener-4d6921d2bfbcfe124574a904c9eb4368-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4d6921d2bfbcfe124574a904c9eb4368/cf 2023-07-15 16:12:18,582 DEBUG [StoreOpener-4d6921d2bfbcfe124574a904c9eb4368-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4d6921d2bfbcfe124574a904c9eb4368/cf 2023-07-15 16:12:18,582 DEBUG [StoreOpener-4ada3ddbee169b939dd4b09687100489-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4ada3ddbee169b939dd4b09687100489/cf 2023-07-15 16:12:18,582 DEBUG [StoreOpener-4ada3ddbee169b939dd4b09687100489-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4ada3ddbee169b939dd4b09687100489/cf 2023-07-15 16:12:18,582 INFO [StoreOpener-4d6921d2bfbcfe124574a904c9eb4368-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4d6921d2bfbcfe124574a904c9eb4368 columnFamilyName cf 2023-07-15 16:12:18,582 INFO [StoreOpener-4ada3ddbee169b939dd4b09687100489-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4ada3ddbee169b939dd4b09687100489 columnFamilyName cf 2023-07-15 16:12:18,583 INFO [StoreOpener-4d6921d2bfbcfe124574a904c9eb4368-1] regionserver.HStore(310): Store=4d6921d2bfbcfe124574a904c9eb4368/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 16:12:18,583 INFO [StoreOpener-4ada3ddbee169b939dd4b09687100489-1] regionserver.HStore(310): Store=4ada3ddbee169b939dd4b09687100489/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 16:12:18,584 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4d6921d2bfbcfe124574a904c9eb4368 2023-07-15 16:12:18,584 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4ada3ddbee169b939dd4b09687100489 2023-07-15 16:12:18,584 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4d6921d2bfbcfe124574a904c9eb4368 2023-07-15 16:12:18,584 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4ada3ddbee169b939dd4b09687100489 2023-07-15 16:12:18,587 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 4d6921d2bfbcfe124574a904c9eb4368 2023-07-15 16:12:18,587 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 4ada3ddbee169b939dd4b09687100489 2023-07-15 16:12:18,589 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4d6921d2bfbcfe124574a904c9eb4368/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 16:12:18,589 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4ada3ddbee169b939dd4b09687100489/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 16:12:18,589 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 4d6921d2bfbcfe124574a904c9eb4368; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70705118, jitterRate=0.05358836054801941}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 16:12:18,590 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 4d6921d2bfbcfe124574a904c9eb4368: 2023-07-15 16:12:18,590 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 4ada3ddbee169b939dd4b09687100489; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61506955, jitterRate=-0.08347494900226593}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 16:12:18,590 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 4ada3ddbee169b939dd4b09687100489: 2023-07-15 16:12:18,590 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689437538216.4d6921d2bfbcfe124574a904c9eb4368., pid=69, masterSystemTime=1689437538572 2023-07-15 16:12:18,591 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689437538216.4ada3ddbee169b939dd4b09687100489., pid=70, masterSystemTime=1689437538573 2023-07-15 16:12:18,592 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689437538216.4d6921d2bfbcfe124574a904c9eb4368. 2023-07-15 16:12:18,592 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689437538216.4d6921d2bfbcfe124574a904c9eb4368. 2023-07-15 16:12:18,593 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=4d6921d2bfbcfe124574a904c9eb4368, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:12:18,593 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689437538216.4ada3ddbee169b939dd4b09687100489. 2023-07-15 16:12:18,593 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1689437538216.4ada3ddbee169b939dd4b09687100489. 2023-07-15 16:12:18,593 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689437538216.4d6921d2bfbcfe124574a904c9eb4368.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689437538593"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689437538593"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689437538593"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689437538593"}]},"ts":"1689437538593"} 2023-07-15 16:12:18,594 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=4ada3ddbee169b939dd4b09687100489, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:18,594 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689437538216.4ada3ddbee169b939dd4b09687100489.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689437538594"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689437538594"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689437538594"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689437538594"}]},"ts":"1689437538594"} 2023-07-15 16:12:18,606 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=67 2023-07-15 16:12:18,606 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=70, resume processing ppid=68 2023-07-15 16:12:18,606 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure 4d6921d2bfbcfe124574a904c9eb4368, server=jenkins-hbase4.apache.org,35773,1689437454990 in 177 msec 2023-07-15 16:12:18,606 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=68, state=SUCCESS; OpenRegionProcedure 4ada3ddbee169b939dd4b09687100489, server=jenkins-hbase4.apache.org,45149,1689437455062 in 176 msec 2023-07-15 16:12:18,608 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4ada3ddbee169b939dd4b09687100489, ASSIGN in 346 msec 2023-07-15 16:12:18,609 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=67, resume processing ppid=66 2023-07-15 16:12:18,609 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4d6921d2bfbcfe124574a904c9eb4368, ASSIGN in 346 msec 2023-07-15 16:12:18,609 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-15 16:12:18,609 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689437538609"}]},"ts":"1689437538609"} 2023-07-15 16:12:18,611 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-07-15 16:12:18,613 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-07-15 16:12:18,613 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-07-15 16:12:18,615 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43103] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-15 16:12:18,617 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 16:12:18,617 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 16:12:18,617 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 16:12:18,617 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 16:12:18,619 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-15 16:12:18,619 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-15 16:12:18,619 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-15 16:12:18,619 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-15 16:12:18,620 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-15 16:12:18,620 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-15 16:12:18,620 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-15 16:12:18,620 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-15 16:12:18,620 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 403 msec 2023-07-15 16:12:18,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-15 16:12:18,824 INFO [Listener at jenkins-hbase4.apache.org/42699] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-07-15 16:12:18,857 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions 4d6921d2bfbcfe124574a904c9eb4368, 4ada3ddbee169b939dd4b09687100489 2023-07-15 16:12:18,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[4d6921d2bfbcfe124574a904c9eb4368, 4ada3ddbee169b939dd4b09687100489], force=true 2023-07-15 16:12:18,871 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[4d6921d2bfbcfe124574a904c9eb4368, 4ada3ddbee169b939dd4b09687100489], force=true 2023-07-15 16:12:18,872 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[4d6921d2bfbcfe124574a904c9eb4368, 4ada3ddbee169b939dd4b09687100489], force=true 2023-07-15 16:12:18,872 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[4d6921d2bfbcfe124574a904c9eb4368, 4ada3ddbee169b939dd4b09687100489], force=true 2023-07-15 16:12:18,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-15 16:12:18,901 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4d6921d2bfbcfe124574a904c9eb4368, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4ada3ddbee169b939dd4b09687100489, UNASSIGN}] 2023-07-15 16:12:18,902 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4d6921d2bfbcfe124574a904c9eb4368, UNASSIGN 2023-07-15 16:12:18,903 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4ada3ddbee169b939dd4b09687100489, UNASSIGN 2023-07-15 16:12:18,903 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=4ada3ddbee169b939dd4b09687100489, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:18,903 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=4d6921d2bfbcfe124574a904c9eb4368, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:12:18,904 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689437538216.4ada3ddbee169b939dd4b09687100489.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689437538903"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689437538903"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689437538903"}]},"ts":"1689437538903"} 2023-07-15 16:12:18,904 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689437538216.4d6921d2bfbcfe124574a904c9eb4368.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689437538903"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689437538903"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689437538903"}]},"ts":"1689437538903"} 2023-07-15 16:12:18,905 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=74, ppid=72, state=RUNNABLE; CloseRegionProcedure 4d6921d2bfbcfe124574a904c9eb4368, server=jenkins-hbase4.apache.org,35773,1689437454990}] 2023-07-15 16:12:18,906 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=75, ppid=73, state=RUNNABLE; CloseRegionProcedure 4ada3ddbee169b939dd4b09687100489, server=jenkins-hbase4.apache.org,45149,1689437455062}] 2023-07-15 16:12:18,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-15 16:12:19,058 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 4d6921d2bfbcfe124574a904c9eb4368 2023-07-15 16:12:19,061 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 4d6921d2bfbcfe124574a904c9eb4368, disabling compactions & flushes 2023-07-15 16:12:19,061 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 4ada3ddbee169b939dd4b09687100489 2023-07-15 16:12:19,061 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689437538216.4d6921d2bfbcfe124574a904c9eb4368. 2023-07-15 16:12:19,061 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689437538216.4d6921d2bfbcfe124574a904c9eb4368. 2023-07-15 16:12:19,062 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 4ada3ddbee169b939dd4b09687100489, disabling compactions & flushes 2023-07-15 16:12:19,062 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689437538216.4d6921d2bfbcfe124574a904c9eb4368. after waiting 0 ms 2023-07-15 16:12:19,062 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689437538216.4d6921d2bfbcfe124574a904c9eb4368. 2023-07-15 16:12:19,062 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689437538216.4ada3ddbee169b939dd4b09687100489. 2023-07-15 16:12:19,062 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689437538216.4ada3ddbee169b939dd4b09687100489. 2023-07-15 16:12:19,062 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 4d6921d2bfbcfe124574a904c9eb4368 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-15 16:12:19,062 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689437538216.4ada3ddbee169b939dd4b09687100489. after waiting 0 ms 2023-07-15 16:12:19,063 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689437538216.4ada3ddbee169b939dd4b09687100489. 2023-07-15 16:12:19,063 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 4ada3ddbee169b939dd4b09687100489 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-15 16:12:19,077 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4d6921d2bfbcfe124574a904c9eb4368/.tmp/cf/0c388391962e418492e6d7b47ec91646 2023-07-15 16:12:19,083 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4ada3ddbee169b939dd4b09687100489/.tmp/cf/5250a2b53b11416ea361e2a653894b78 2023-07-15 16:12:19,092 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4d6921d2bfbcfe124574a904c9eb4368/.tmp/cf/0c388391962e418492e6d7b47ec91646 as hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4d6921d2bfbcfe124574a904c9eb4368/cf/0c388391962e418492e6d7b47ec91646 2023-07-15 16:12:19,095 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4ada3ddbee169b939dd4b09687100489/.tmp/cf/5250a2b53b11416ea361e2a653894b78 as hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4ada3ddbee169b939dd4b09687100489/cf/5250a2b53b11416ea361e2a653894b78 2023-07-15 16:12:19,105 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4d6921d2bfbcfe124574a904c9eb4368/cf/0c388391962e418492e6d7b47ec91646, entries=1, sequenceid=5, filesize=4.7 K 2023-07-15 16:12:19,106 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 4d6921d2bfbcfe124574a904c9eb4368 in 44ms, sequenceid=5, compaction requested=false 2023-07-15 16:12:19,106 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-15 16:12:19,108 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4ada3ddbee169b939dd4b09687100489/cf/5250a2b53b11416ea361e2a653894b78, entries=1, sequenceid=5, filesize=4.7 K 2023-07-15 16:12:19,109 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 4ada3ddbee169b939dd4b09687100489 in 46ms, sequenceid=5, compaction requested=false 2023-07-15 16:12:19,137 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4d6921d2bfbcfe124574a904c9eb4368/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-15 16:12:19,138 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4ada3ddbee169b939dd4b09687100489/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-15 16:12:19,139 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 16:12:19,139 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689437538216.4ada3ddbee169b939dd4b09687100489. 2023-07-15 16:12:19,139 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 4ada3ddbee169b939dd4b09687100489: 2023-07-15 16:12:19,141 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 4ada3ddbee169b939dd4b09687100489 2023-07-15 16:12:19,141 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=4ada3ddbee169b939dd4b09687100489, regionState=CLOSED 2023-07-15 16:12:19,141 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689437538216.4ada3ddbee169b939dd4b09687100489.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689437539141"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689437539141"}]},"ts":"1689437539141"} 2023-07-15 16:12:19,145 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=75, resume processing ppid=73 2023-07-15 16:12:19,145 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=73, state=SUCCESS; CloseRegionProcedure 4ada3ddbee169b939dd4b09687100489, server=jenkins-hbase4.apache.org,45149,1689437455062 in 237 msec 2023-07-15 16:12:19,146 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4ada3ddbee169b939dd4b09687100489, UNASSIGN in 245 msec 2023-07-15 16:12:19,151 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 16:12:19,151 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689437538216.4d6921d2bfbcfe124574a904c9eb4368. 2023-07-15 16:12:19,151 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 4d6921d2bfbcfe124574a904c9eb4368: 2023-07-15 16:12:19,153 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 4d6921d2bfbcfe124574a904c9eb4368 2023-07-15 16:12:19,154 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=4d6921d2bfbcfe124574a904c9eb4368, regionState=CLOSED 2023-07-15 16:12:19,154 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689437538216.4d6921d2bfbcfe124574a904c9eb4368.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689437539154"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689437539154"}]},"ts":"1689437539154"} 2023-07-15 16:12:19,157 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=74, resume processing ppid=72 2023-07-15 16:12:19,157 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=72, state=SUCCESS; CloseRegionProcedure 4d6921d2bfbcfe124574a904c9eb4368, server=jenkins-hbase4.apache.org,35773,1689437454990 in 251 msec 2023-07-15 16:12:19,159 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=72, resume processing ppid=71 2023-07-15 16:12:19,159 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4d6921d2bfbcfe124574a904c9eb4368, UNASSIGN in 261 msec 2023-07-15 16:12:19,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-15 16:12:19,255 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d3200db8ca9fabbdbce9e34f9763e8b4/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-15 16:12:19,258 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689437538216.4d6921d2bfbcfe124574a904c9eb4368.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-15 16:12:19,258 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689437538216.4ada3ddbee169b939dd4b09687100489.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-15 16:12:19,258 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689437538217.d3200db8ca9fabbdbce9e34f9763e8b4.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-15 16:12:19,349 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d3200db8ca9fabbdbce9e34f9763e8b4, ASSIGN}] 2023-07-15 16:12:19,355 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d3200db8ca9fabbdbce9e34f9763e8b4, ASSIGN 2023-07-15 16:12:19,356 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d3200db8ca9fabbdbce9e34f9763e8b4, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,35773,1689437454990; forceNewPlan=false, retain=false 2023-07-15 16:12:19,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-15 16:12:19,506 INFO [jenkins-hbase4:37255] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-15 16:12:19,508 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=d3200db8ca9fabbdbce9e34f9763e8b4, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:12:19,508 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689437538217.d3200db8ca9fabbdbce9e34f9763e8b4.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689437539508"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689437539508"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689437539508"}]},"ts":"1689437539508"} 2023-07-15 16:12:19,510 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure d3200db8ca9fabbdbce9e34f9763e8b4, server=jenkins-hbase4.apache.org,35773,1689437454990}] 2023-07-15 16:12:19,665 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689437538217.d3200db8ca9fabbdbce9e34f9763e8b4. 2023-07-15 16:12:19,665 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d3200db8ca9fabbdbce9e34f9763e8b4, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689437538217.d3200db8ca9fabbdbce9e34f9763e8b4.', STARTKEY => '', ENDKEY => ''} 2023-07-15 16:12:19,665 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689437538217.d3200db8ca9fabbdbce9e34f9763e8b4. service=AccessControlService 2023-07-15 16:12:19,666 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 16:12:19,666 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 d3200db8ca9fabbdbce9e34f9763e8b4 2023-07-15 16:12:19,666 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689437538217.d3200db8ca9fabbdbce9e34f9763e8b4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 16:12:19,666 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d3200db8ca9fabbdbce9e34f9763e8b4 2023-07-15 16:12:19,666 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d3200db8ca9fabbdbce9e34f9763e8b4 2023-07-15 16:12:19,667 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d3200db8ca9fabbdbce9e34f9763e8b4/.regioninfo 2023-07-15 16:12:19,680 INFO [StoreOpener-d3200db8ca9fabbdbce9e34f9763e8b4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region d3200db8ca9fabbdbce9e34f9763e8b4 2023-07-15 16:12:19,681 DEBUG [StoreOpener-d3200db8ca9fabbdbce9e34f9763e8b4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d3200db8ca9fabbdbce9e34f9763e8b4/cf 2023-07-15 16:12:19,681 DEBUG [StoreOpener-d3200db8ca9fabbdbce9e34f9763e8b4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d3200db8ca9fabbdbce9e34f9763e8b4/cf 2023-07-15 16:12:19,682 INFO [StoreOpener-d3200db8ca9fabbdbce9e34f9763e8b4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d3200db8ca9fabbdbce9e34f9763e8b4 columnFamilyName cf 2023-07-15 16:12:19,717 DEBUG [StoreOpener-d3200db8ca9fabbdbce9e34f9763e8b4-1] regionserver.HStore(539): loaded hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d3200db8ca9fabbdbce9e34f9763e8b4/cf/0c388391962e418492e6d7b47ec91646.4d6921d2bfbcfe124574a904c9eb4368->hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4d6921d2bfbcfe124574a904c9eb4368/cf/0c388391962e418492e6d7b47ec91646-top 2023-07-15 16:12:19,723 DEBUG [StoreOpener-d3200db8ca9fabbdbce9e34f9763e8b4-1] regionserver.HStore(539): loaded hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d3200db8ca9fabbdbce9e34f9763e8b4/cf/5250a2b53b11416ea361e2a653894b78.4ada3ddbee169b939dd4b09687100489->hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4ada3ddbee169b939dd4b09687100489/cf/5250a2b53b11416ea361e2a653894b78-top 2023-07-15 16:12:19,724 INFO [StoreOpener-d3200db8ca9fabbdbce9e34f9763e8b4-1] regionserver.HStore(310): Store=d3200db8ca9fabbdbce9e34f9763e8b4/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 16:12:19,727 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d3200db8ca9fabbdbce9e34f9763e8b4 2023-07-15 16:12:19,728 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d3200db8ca9fabbdbce9e34f9763e8b4 2023-07-15 16:12:19,732 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d3200db8ca9fabbdbce9e34f9763e8b4 2023-07-15 16:12:19,732 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d3200db8ca9fabbdbce9e34f9763e8b4; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68599541, jitterRate=0.022212818264961243}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 16:12:19,732 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d3200db8ca9fabbdbce9e34f9763e8b4: 2023-07-15 16:12:19,733 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689437538217.d3200db8ca9fabbdbce9e34f9763e8b4., pid=77, masterSystemTime=1689437539662 2023-07-15 16:12:19,734 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1689437538217.d3200db8ca9fabbdbce9e34f9763e8b4.,because compaction is disabled. 2023-07-15 16:12:19,735 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689437538217.d3200db8ca9fabbdbce9e34f9763e8b4. 2023-07-15 16:12:19,735 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689437538217.d3200db8ca9fabbdbce9e34f9763e8b4. 2023-07-15 16:12:19,735 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=d3200db8ca9fabbdbce9e34f9763e8b4, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:12:19,736 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689437538217.d3200db8ca9fabbdbce9e34f9763e8b4.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689437539735"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689437539735"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689437539735"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689437539735"}]},"ts":"1689437539735"} 2023-07-15 16:12:19,741 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-15 16:12:19,741 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure d3200db8ca9fabbdbce9e34f9763e8b4, server=jenkins-hbase4.apache.org,35773,1689437454990 in 229 msec 2023-07-15 16:12:19,742 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=71 2023-07-15 16:12:19,742 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d3200db8ca9fabbdbce9e34f9763e8b4, ASSIGN in 392 msec 2023-07-15 16:12:19,744 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[4d6921d2bfbcfe124574a904c9eb4368, 4ada3ddbee169b939dd4b09687100489], force=true in 881 msec 2023-07-15 16:12:19,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-15 16:12:19,986 INFO [Listener at jenkins-hbase4.apache.org/42699] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-07-15 16:12:19,987 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-15 16:12:19,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689437539987 (current time:1689437539987). 2023-07-15 16:12:19,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 16:12:19,988 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] zookeeper.ReadOnlyZKClient(139): Connect 0x6e51bb97 to 127.0.0.1:58438 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 16:12:20,001 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2e182c2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 16:12:20,008 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 16:12:20,009 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60364, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 16:12:20,010 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6e51bb97 to 127.0.0.1:58438 2023-07-15 16:12:20,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 16:12:20,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] zookeeper.ReadOnlyZKClient(139): Connect 0x0ec171fa to 127.0.0.1:58438 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 16:12:20,018 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6daffeb6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 16:12:20,020 DEBUG [hconnection-0x63568653-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 16:12:20,023 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60378, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 16:12:20,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0ec171fa to 127.0.0.1:58438 2023-07-15 16:12:20,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 16:12:20,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-15 16:12:20,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 16:12:20,029 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-15 16:12:20,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-15 16:12:20,032 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-15 16:12:20,033 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1689438140033 2023-07-15 16:12:20,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-15 16:12:20,033 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:20,036 DEBUG [Listener at jenkins-hbase4.apache.org/42699] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 16:12:20,037 DEBUG [Listener at jenkins-hbase4.apache.org/42699] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 16:12:20,037 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-15 16:12:20,038 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-15 16:12:20,039 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 8 msec 2023-07-15 16:12:20,040 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-15 16:12:20,041 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1689438140041 2023-07-15 16:12:20,062 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:20,063 INFO [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-07-15 16:12:20,063 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 16:12:20,064 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-07-15 16:12:20,064 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-07-15 16:12:20,065 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:20,065 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:20,066 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:12:20,067 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:12:20,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:12:20,067 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:12:20,067 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:12:20,067 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:12:20,067 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:12:20,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:12:20,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:12:20,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:20,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:20,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:20,068 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:20,068 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:20,068 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:20,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-15 16:12:20,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:20,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-15 16:12:20,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:20,069 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-15 16:12:20,069 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-15 16:12:20,069 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:12:20,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-15 16:12:20,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:20,069 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-15 16:12:20,070 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:12:20,070 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 16:12:20,074 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:20,075 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-15 16:12:20,075 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 16:12:20,080 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-15 16:12:20,080 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-15 16:12:20,080 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35773,1689437454990' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-15 16:12:20,081 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:12:20,081 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:20,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:12:20,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:12:20,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:12:20,082 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:20,082 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 16:12:20,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:12:20,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:12:20,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:20,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:12:20,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:12:20,084 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35773,1689437454990' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-07-15 16:12:20,084 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7035e8ed[Count = 0] remaining members to acquire global barrier 2023-07-15 16:12:20,084 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-07-15 16:12:20,084 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:20,085 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:20,085 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:20,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:20,085 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-15 16:12:20,086 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:20,086 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 16:12:20,086 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:20,086 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 16:12:20,086 DEBUG [rs(jenkins-hbase4.apache.org,35773,1689437454990)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689437538217.d3200db8ca9fabbdbce9e34f9763e8b4. 2023-07-15 16:12:20,086 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-15 16:12:20,086 DEBUG [rs(jenkins-hbase4.apache.org,35773,1689437454990)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689437538217.d3200db8ca9fabbdbce9e34f9763e8b4. started... 2023-07-15 16:12:20,086 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-15 16:12:20,086 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 16:12:20,086 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 16:12:20,088 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-15 16:12:20,088 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-15 16:12:20,088 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43103,1689437454905' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-15 16:12:20,090 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-15 16:12:20,090 DEBUG [rs(jenkins-hbase4.apache.org,35773,1689437454990)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d3200db8ca9fabbdbce9e34f9763e8b4: 2023-07-15 16:12:20,090 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:12:20,090 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 16:12:20,090 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-15 16:12:20,090 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45149,1689437455062' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-15 16:12:20,090 DEBUG [rs(jenkins-hbase4.apache.org,35773,1689437454990)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689437538217.d3200db8ca9fabbdbce9e34f9763e8b4.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:20,090 DEBUG [rs(jenkins-hbase4.apache.org,35773,1689437454990)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 16:12:20,090 DEBUG [rs(jenkins-hbase4.apache.org,35773,1689437454990)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d3200db8ca9fabbdbce9e34f9763e8b4/cf/0c388391962e418492e6d7b47ec91646.4d6921d2bfbcfe124574a904c9eb4368->hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4d6921d2bfbcfe124574a904c9eb4368/cf/0c388391962e418492e6d7b47ec91646-top, hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d3200db8ca9fabbdbce9e34f9763e8b4/cf/5250a2b53b11416ea361e2a653894b78.4ada3ddbee169b939dd4b09687100489->hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4ada3ddbee169b939dd4b09687100489/cf/5250a2b53b11416ea361e2a653894b78-top] hfiles 2023-07-15 16:12:20,091 DEBUG [rs(jenkins-hbase4.apache.org,35773,1689437454990)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d3200db8ca9fabbdbce9e34f9763e8b4/cf/0c388391962e418492e6d7b47ec91646.4d6921d2bfbcfe124574a904c9eb4368 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:20,091 DEBUG [rs(jenkins-hbase4.apache.org,35773,1689437454990)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d3200db8ca9fabbdbce9e34f9763e8b4/cf/5250a2b53b11416ea361e2a653894b78.4ada3ddbee169b939dd4b09687100489 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:20,099 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:20,100 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:20,100 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] zookeeper.ZKUtil(162): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:20,100 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:20,100 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 16:12:20,100 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-15 16:12:20,100 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-15 16:12:20,100 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,43103,1689437454905' in zk 2023-07-15 16:12:20,100 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] zookeeper.ZKUtil(162): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:20,100 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:20,100 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 16:12:20,100 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-15 16:12:20,100 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-15 16:12:20,100 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,45149,1689437455062' in zk 2023-07-15 16:12:20,101 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-15 16:12:20,101 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 16:12:20,102 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-15 16:12:20,105 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-15 16:12:20,105 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 16:12:20,105 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-15 16:12:20,121 DEBUG [rs(jenkins-hbase4.apache.org,35773,1689437454990)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689437538217.d3200db8ca9fabbdbce9e34f9763e8b4. completed. 2023-07-15 16:12:20,121 DEBUG [rs(jenkins-hbase4.apache.org,35773,1689437454990)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689437538217.d3200db8ca9fabbdbce9e34f9763e8b4. 2023-07-15 16:12:20,121 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 16:12:20,122 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 16:12:20,122 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:12:20,122 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-15 16:12:20,122 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,35773,1689437454990' in zk 2023-07-15 16:12:20,127 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:12:20,127 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-15 16:12:20,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:12:20,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:12:20,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:12:20,127 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 16:12:20,128 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-15 16:12:20,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:12:20,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:12:20,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:20,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:12:20,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:20,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:20,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:12:20,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:20,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:20,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:12:20,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:20,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,35773,1689437454990': 2023-07-15 16:12:20,133 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35773,1689437454990' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-07-15 16:12:20,133 INFO [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-07-15 16:12:20,133 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 16:12:20,133 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 16:12:20,133 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:20,133 INFO [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 16:12:20,134 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689437464006_0004_000001 (auth:SIMPLE) 2023-07-15 16:12:20,135 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:20,135 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:20,135 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:20,135 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:20,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:20,135 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:12:20,135 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:20,135 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:20,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:20,135 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:12:20,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:12:20,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:12:20,136 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:20,136 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:12:20,135 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:12:20,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:20,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:12:20,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:20,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:12:20,136 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:12:20,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:12:20,136 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:12:20,136 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:12:20,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:20,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:20,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:20,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:12:20,137 DEBUG [Listener at jenkins-hbase4.apache.org/42699] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 16:12:20,137 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:20,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:12:20,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:20,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:20,138 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:20,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-15 16:12:20,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-15 16:12:20,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:12:20,138 DEBUG [Listener at jenkins-hbase4.apache.org/42699] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 16:12:20,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:20,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:20,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:12:20,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:20,140 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:20,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:20,140 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:12:20,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:12:20,141 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:20,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:20,147 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:12:20,147 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:12:20,147 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:20,147 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:12:20,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:12:20,147 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:12:20,147 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:12:20,147 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:20,147 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:20,147 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:12:20,147 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:12:20,147 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:12:20,147 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:12:20,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:12:20,147 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 16:12:20,147 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:20,147 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:20,148 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:20,148 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:20,148 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:12:20,148 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:20,148 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:20,148 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:20,148 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:12:20,148 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:20,148 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:12:20,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:12:20,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:12:20,148 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:20,148 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:20,149 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:20,149 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:12:20,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:12:20,149 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:12:20,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:12:20,192 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:20,266 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-07-15 16:12:20,266 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:20,268 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:20,269 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1689437540033Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689437540148 (+115 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689437540148Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689437540155 (+7 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689437540184 (+29 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1689437540266 (+82 ms) 2023-07-15 16:12:20,272 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-15 16:12:20,274 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 236 msec 2023-07-15 16:12:20,339 DEBUG [Listener at jenkins-hbase4.apache.org/42699] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 16:12:20,340 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-15 16:12:20,340 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 16:12:20,340 INFO [Listener at jenkins-hbase4.apache.org/42699] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/export-test/export-1689437540340 2023-07-15 16:12:20,341 INFO [Listener at jenkins-hbase4.apache.org/42699] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:44749, tgtDir=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/export-test/export-1689437540340, rawTgtDir=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/export-test/export-1689437540340, srcFsUri=hdfs://localhost:44749, srcDir=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8 2023-07-15 16:12:20,364 DEBUG [Listener at jenkins-hbase4.apache.org/42699] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44749, inputRoot=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8 2023-07-15 16:12:20,365 DEBUG [Listener at jenkins-hbase4.apache.org/42699] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1064385191_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/export-test/export-1689437540340, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/export-test/export-1689437540340/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:20,365 INFO [Listener at jenkins-hbase4.apache.org/42699] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44749, inputRoot=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8, snapshotDir=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-07-15 16:12:20,377 INFO [Listener at jenkins-hbase4.apache.org/42699] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/export-test/export-1689437540340/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:20,403 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-15 16:12:20,403 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-15 16:12:20,404 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-15 16:12:20,404 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-15 16:12:21,492 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1587f29c-5daf-234a-1773-5088522b715e/hadoop-1392378301057930086.jar 2023-07-15 16:12:21,493 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-15 16:12:21,493 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-15 16:12:21,552 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-15 16:12:21,574 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1587f29c-5daf-234a-1773-5088522b715e/hadoop-8888057562583113247.jar 2023-07-15 16:12:21,574 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-15 16:12:21,575 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-15 16:12:21,576 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-15 16:12:21,576 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-15 16:12:21,577 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-15 16:12:21,577 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-15 16:12:21,578 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-15 16:12:21,579 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-15 16:12:21,579 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-15 16:12:21,580 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-15 16:12:21,580 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-15 16:12:21,581 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-15 16:12:21,581 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-15 16:12:21,582 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-15 16:12:21,582 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-15 16:12:21,583 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-15 16:12:21,584 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 16:12:21,585 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 16:12:21,586 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 16:12:21,586 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 16:12:21,586 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 16:12:21,587 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 16:12:21,588 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 16:12:22,443 WARN [Listener at jenkins-hbase4.apache.org/42699] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-15 16:12:22,447 INFO [Listener at jenkins-hbase4.apache.org/42699] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-07-15 16:12:22,449 DEBUG [Listener at jenkins-hbase4.apache.org/42699] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-07-15 16:12:22,577 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 16:12:22,578 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 16:12:23,144 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689437464006_0005_000001 (auth:SIMPLE) 2023-07-15 16:12:28,556 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689437464006_0005_000001 (auth:SIMPLE) 2023-07-15 16:12:30,864 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689437464006_0005_000001 (auth:SIMPLE) 2023-07-15 16:12:35,029 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689437464006_0005_000001 (auth:SIMPLE) 2023-07-15 16:12:36,873 INFO [Listener at jenkins-hbase4.apache.org/42699] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-15 16:12:36,878 INFO [Listener at jenkins-hbase4.apache.org/42699] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-15 16:12:36,895 INFO [Listener at jenkins-hbase4.apache.org/42699] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:36,895 INFO [Listener at jenkins-hbase4.apache.org/42699] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-15 16:12:36,896 INFO [Listener at jenkins-hbase4.apache.org/42699] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-15 16:12:36,896 DEBUG [Listener at jenkins-hbase4.apache.org/42699] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-127961896_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:36,896 DEBUG [Listener at jenkins-hbase4.apache.org/42699] snapshot.TestExportSnapshot(367): hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-15 16:12:36,896 DEBUG [Listener at jenkins-hbase4.apache.org/42699] snapshot.TestExportSnapshot(367): hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-15 16:12:36,897 DEBUG [Listener at jenkins-hbase4.apache.org/42699] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-127961896_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/export-test/export-1689437540340/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/export-test/export-1689437540340/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:36,897 DEBUG [Listener at jenkins-hbase4.apache.org/42699] snapshot.TestExportSnapshot(367): hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/export-test/export-1689437540340/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-15 16:12:36,897 DEBUG [Listener at jenkins-hbase4.apache.org/42699] snapshot.TestExportSnapshot(367): hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/export-test/export-1689437540340/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-15 16:12:36,906 INFO [Listener at jenkins-hbase4.apache.org/42699] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:36,906 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:36,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] procedure2.ProcedureExecutor(1029): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:36,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-15 16:12:36,913 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689437556913"}]},"ts":"1689437556913"} 2023-07-15 16:12:36,915 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-07-15 16:12:36,917 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-07-15 16:12:36,919 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d3200db8ca9fabbdbce9e34f9763e8b4, UNASSIGN}] 2023-07-15 16:12:36,921 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d3200db8ca9fabbdbce9e34f9763e8b4, UNASSIGN 2023-07-15 16:12:36,923 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=d3200db8ca9fabbdbce9e34f9763e8b4, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:12:36,923 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689437538217.d3200db8ca9fabbdbce9e34f9763e8b4.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689437556923"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689437556923"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689437556923"}]},"ts":"1689437556923"} 2023-07-15 16:12:36,925 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure d3200db8ca9fabbdbce9e34f9763e8b4, server=jenkins-hbase4.apache.org,35773,1689437454990}] 2023-07-15 16:12:37,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-15 16:12:37,079 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close d3200db8ca9fabbdbce9e34f9763e8b4 2023-07-15 16:12:37,079 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d3200db8ca9fabbdbce9e34f9763e8b4, disabling compactions & flushes 2023-07-15 16:12:37,079 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689437538217.d3200db8ca9fabbdbce9e34f9763e8b4. 2023-07-15 16:12:37,079 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689437538217.d3200db8ca9fabbdbce9e34f9763e8b4. 2023-07-15 16:12:37,079 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689437538217.d3200db8ca9fabbdbce9e34f9763e8b4. after waiting 0 ms 2023-07-15 16:12:37,079 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689437538217.d3200db8ca9fabbdbce9e34f9763e8b4. 2023-07-15 16:12:37,122 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d3200db8ca9fabbdbce9e34f9763e8b4/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-15 16:12:37,123 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 16:12:37,124 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689437538217.d3200db8ca9fabbdbce9e34f9763e8b4. 2023-07-15 16:12:37,124 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d3200db8ca9fabbdbce9e34f9763e8b4: 2023-07-15 16:12:37,127 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=d3200db8ca9fabbdbce9e34f9763e8b4, regionState=CLOSED 2023-07-15 16:12:37,127 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689437538217.d3200db8ca9fabbdbce9e34f9763e8b4.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689437557127"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689437557127"}]},"ts":"1689437557127"} 2023-07-15 16:12:37,133 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=81 2023-07-15 16:12:37,133 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure d3200db8ca9fabbdbce9e34f9763e8b4, server=jenkins-hbase4.apache.org,35773,1689437454990 in 206 msec 2023-07-15 16:12:37,135 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed d3200db8ca9fabbdbce9e34f9763e8b4 2023-07-15 16:12:37,139 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=80 2023-07-15 16:12:37,139 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d3200db8ca9fabbdbce9e34f9763e8b4, UNASSIGN in 214 msec 2023-07-15 16:12:37,140 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689437557140"}]},"ts":"1689437557140"} 2023-07-15 16:12:37,143 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-07-15 16:12:37,178 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-07-15 16:12:37,180 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 272 msec 2023-07-15 16:12:37,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-15 16:12:37,216 INFO [Listener at jenkins-hbase4.apache.org/42699] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-07-15 16:12:37,218 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:37,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] procedure2.ProcedureExecutor(1029): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:37,224 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:37,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:37,225 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:37,227 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43103] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:37,235 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d3200db8ca9fabbdbce9e34f9763e8b4 2023-07-15 16:12:37,245 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4ada3ddbee169b939dd4b09687100489 2023-07-15 16:12:37,245 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4d6921d2bfbcfe124574a904c9eb4368 2023-07-15 16:12:37,247 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4ada3ddbee169b939dd4b09687100489/cf, FileablePath, hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4ada3ddbee169b939dd4b09687100489/recovered.edits] 2023-07-15 16:12:37,252 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d3200db8ca9fabbdbce9e34f9763e8b4/cf, FileablePath, hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d3200db8ca9fabbdbce9e34f9763e8b4/recovered.edits] 2023-07-15 16:12:37,261 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4d6921d2bfbcfe124574a904c9eb4368/cf, FileablePath, hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4d6921d2bfbcfe124574a904c9eb4368/recovered.edits] 2023-07-15 16:12:37,262 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d3200db8ca9fabbdbce9e34f9763e8b4/cf/0c388391962e418492e6d7b47ec91646.4d6921d2bfbcfe124574a904c9eb4368 to hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d3200db8ca9fabbdbce9e34f9763e8b4/cf/0c388391962e418492e6d7b47ec91646.4d6921d2bfbcfe124574a904c9eb4368 2023-07-15 16:12:37,262 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4ada3ddbee169b939dd4b09687100489/cf/5250a2b53b11416ea361e2a653894b78 to hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4ada3ddbee169b939dd4b09687100489/cf/5250a2b53b11416ea361e2a653894b78 2023-07-15 16:12:37,266 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d3200db8ca9fabbdbce9e34f9763e8b4/cf/5250a2b53b11416ea361e2a653894b78.4ada3ddbee169b939dd4b09687100489 to hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d3200db8ca9fabbdbce9e34f9763e8b4/cf/5250a2b53b11416ea361e2a653894b78.4ada3ddbee169b939dd4b09687100489 2023-07-15 16:12:37,275 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4ada3ddbee169b939dd4b09687100489/recovered.edits/8.seqid to hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4ada3ddbee169b939dd4b09687100489/recovered.edits/8.seqid 2023-07-15 16:12:37,276 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4d6921d2bfbcfe124574a904c9eb4368/cf/0c388391962e418492e6d7b47ec91646 to hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4d6921d2bfbcfe124574a904c9eb4368/cf/0c388391962e418492e6d7b47ec91646 2023-07-15 16:12:37,279 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4ada3ddbee169b939dd4b09687100489 2023-07-15 16:12:37,280 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4d6921d2bfbcfe124574a904c9eb4368/recovered.edits/8.seqid to hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4d6921d2bfbcfe124574a904c9eb4368/recovered.edits/8.seqid 2023-07-15 16:12:37,281 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4d6921d2bfbcfe124574a904c9eb4368 2023-07-15 16:12:37,282 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d3200db8ca9fabbdbce9e34f9763e8b4/recovered.edits/12.seqid to hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d3200db8ca9fabbdbce9e34f9763e8b4/recovered.edits/12.seqid 2023-07-15 16:12:37,282 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d3200db8ca9fabbdbce9e34f9763e8b4 2023-07-15 16:12:37,282 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-15 16:12:37,285 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:37,292 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-07-15 16:12:37,309 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:37,309 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:37,309 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:37,309 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:37,309 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-15 16:12:37,309 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-15 16:12:37,309 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-15 16:12:37,310 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-15 16:12:37,310 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-07-15 16:12:37,311 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:37,311 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-07-15 16:12:37,312 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689437538217.d3200db8ca9fabbdbce9e34f9763e8b4.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689437557311"}]},"ts":"9223372036854775807"} 2023-07-15 16:12:37,320 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-15 16:12:37,320 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => d3200db8ca9fabbdbce9e34f9763e8b4, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689437538217.d3200db8ca9fabbdbce9e34f9763e8b4.', STARTKEY => '', ENDKEY => ''}] 2023-07-15 16:12:37,320 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-07-15 16:12:37,320 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689437557320"}]},"ts":"9223372036854775807"} 2023-07-15 16:12:37,325 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-07-15 16:12:37,347 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:37,347 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:37,347 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 16:12:37,347 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:37,347 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 16:12:37,347 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 16:12:37,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-15 16:12:37,353 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:37,353 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 16:12:37,401 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-15 16:12:37,401 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-15 16:12:37,401 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-15 16:12:37,401 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-15 16:12:37,402 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:37,403 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 184 msec 2023-07-15 16:12:37,450 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-15 16:12:37,450 INFO [Listener at jenkins-hbase4.apache.org/42699] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-07-15 16:12:37,451 INFO [Listener at jenkins-hbase4.apache.org/42699] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:37,452 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:37,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] procedure2.ProcedureExecutor(1029): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:37,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-15 16:12:37,457 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689437557457"}]},"ts":"1689437557457"} 2023-07-15 16:12:37,458 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-07-15 16:12:37,517 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-07-15 16:12:37,518 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=88c6238f8097f3ef1058d488881fd8e7, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=9b7c5797a4ac81296849f2c2fa5aa9e1, UNASSIGN}] 2023-07-15 16:12:37,521 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=88c6238f8097f3ef1058d488881fd8e7, UNASSIGN 2023-07-15 16:12:37,521 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=9b7c5797a4ac81296849f2c2fa5aa9e1, UNASSIGN 2023-07-15 16:12:37,521 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=9b7c5797a4ac81296849f2c2fa5aa9e1, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:37,521 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=88c6238f8097f3ef1058d488881fd8e7, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:37,522 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689437536308.88c6238f8097f3ef1058d488881fd8e7.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689437557521"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689437557521"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689437557521"}]},"ts":"1689437557521"} 2023-07-15 16:12:37,522 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689437536308.9b7c5797a4ac81296849f2c2fa5aa9e1.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689437557521"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689437557521"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689437557521"}]},"ts":"1689437557521"} 2023-07-15 16:12:37,524 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=85, state=RUNNABLE; CloseRegionProcedure 88c6238f8097f3ef1058d488881fd8e7, server=jenkins-hbase4.apache.org,43103,1689437454905}] 2023-07-15 16:12:37,525 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=86, state=RUNNABLE; CloseRegionProcedure 9b7c5797a4ac81296849f2c2fa5aa9e1, server=jenkins-hbase4.apache.org,45149,1689437455062}] 2023-07-15 16:12:37,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-15 16:12:37,677 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 88c6238f8097f3ef1058d488881fd8e7 2023-07-15 16:12:37,677 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 88c6238f8097f3ef1058d488881fd8e7, disabling compactions & flushes 2023-07-15 16:12:37,677 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689437536308.88c6238f8097f3ef1058d488881fd8e7. 2023-07-15 16:12:37,677 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689437536308.88c6238f8097f3ef1058d488881fd8e7. 2023-07-15 16:12:37,677 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689437536308.88c6238f8097f3ef1058d488881fd8e7. after waiting 0 ms 2023-07-15 16:12:37,677 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689437536308.88c6238f8097f3ef1058d488881fd8e7. 2023-07-15 16:12:37,679 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 9b7c5797a4ac81296849f2c2fa5aa9e1 2023-07-15 16:12:37,681 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 9b7c5797a4ac81296849f2c2fa5aa9e1, disabling compactions & flushes 2023-07-15 16:12:37,681 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689437536308.9b7c5797a4ac81296849f2c2fa5aa9e1. 2023-07-15 16:12:37,682 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689437536308.9b7c5797a4ac81296849f2c2fa5aa9e1. 2023-07-15 16:12:37,682 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689437536308.9b7c5797a4ac81296849f2c2fa5aa9e1. after waiting 0 ms 2023-07-15 16:12:37,682 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689437536308.9b7c5797a4ac81296849f2c2fa5aa9e1. 2023-07-15 16:12:37,703 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportFileSystemStateWithMergeRegion/88c6238f8097f3ef1058d488881fd8e7/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 16:12:37,703 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 16:12:37,704 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportFileSystemStateWithMergeRegion/9b7c5797a4ac81296849f2c2fa5aa9e1/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 16:12:37,705 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689437536308.88c6238f8097f3ef1058d488881fd8e7. 2023-07-15 16:12:37,705 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 88c6238f8097f3ef1058d488881fd8e7: 2023-07-15 16:12:37,706 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 16:12:37,708 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689437536308.9b7c5797a4ac81296849f2c2fa5aa9e1. 2023-07-15 16:12:37,708 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 9b7c5797a4ac81296849f2c2fa5aa9e1: 2023-07-15 16:12:37,709 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 88c6238f8097f3ef1058d488881fd8e7 2023-07-15 16:12:37,709 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=88c6238f8097f3ef1058d488881fd8e7, regionState=CLOSED 2023-07-15 16:12:37,710 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689437536308.88c6238f8097f3ef1058d488881fd8e7.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689437557709"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689437557709"}]},"ts":"1689437557709"} 2023-07-15 16:12:37,710 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 9b7c5797a4ac81296849f2c2fa5aa9e1 2023-07-15 16:12:37,714 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=9b7c5797a4ac81296849f2c2fa5aa9e1, regionState=CLOSED 2023-07-15 16:12:37,714 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689437536308.9b7c5797a4ac81296849f2c2fa5aa9e1.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689437557714"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689437557714"}]},"ts":"1689437557714"} 2023-07-15 16:12:37,718 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=85 2023-07-15 16:12:37,718 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=85, state=SUCCESS; CloseRegionProcedure 88c6238f8097f3ef1058d488881fd8e7, server=jenkins-hbase4.apache.org,43103,1689437454905 in 191 msec 2023-07-15 16:12:37,719 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=86 2023-07-15 16:12:37,719 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=86, state=SUCCESS; CloseRegionProcedure 9b7c5797a4ac81296849f2c2fa5aa9e1, server=jenkins-hbase4.apache.org,45149,1689437455062 in 191 msec 2023-07-15 16:12:37,720 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=88c6238f8097f3ef1058d488881fd8e7, UNASSIGN in 200 msec 2023-07-15 16:12:37,721 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=86, resume processing ppid=84 2023-07-15 16:12:37,721 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=9b7c5797a4ac81296849f2c2fa5aa9e1, UNASSIGN in 201 msec 2023-07-15 16:12:37,722 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689437557722"}]},"ts":"1689437557722"} 2023-07-15 16:12:37,723 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-07-15 16:12:37,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-15 16:12:37,808 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-07-15 16:12:37,811 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 358 msec 2023-07-15 16:12:38,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-15 16:12:38,061 INFO [Listener at jenkins-hbase4.apache.org/42699] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-07-15 16:12:38,062 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:38,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] procedure2.ProcedureExecutor(1029): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:38,066 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:38,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:38,068 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:38,069 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43103] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:38,072 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:38,072 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:38,072 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:38,073 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:38,073 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-15 16:12:38,073 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-15 16:12:38,073 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-15 16:12:38,074 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-15 16:12:38,075 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/88c6238f8097f3ef1058d488881fd8e7 2023-07-15 16:12:38,075 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9b7c5797a4ac81296849f2c2fa5aa9e1 2023-07-15 16:12:38,076 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:38,076 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 16:12:38,076 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:38,076 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:38,076 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 16:12:38,076 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 16:12:38,077 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:38,077 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 16:12:38,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-15 16:12:38,082 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/88c6238f8097f3ef1058d488881fd8e7/cf, FileablePath, hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/88c6238f8097f3ef1058d488881fd8e7/recovered.edits] 2023-07-15 16:12:38,082 DEBUG [HFileArchiver-16] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9b7c5797a4ac81296849f2c2fa5aa9e1/cf, FileablePath, hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9b7c5797a4ac81296849f2c2fa5aa9e1/recovered.edits] 2023-07-15 16:12:38,089 DEBUG [HFileArchiver-16] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9b7c5797a4ac81296849f2c2fa5aa9e1/cf/b86bd757fdf94e38ac5ef58761f3397b to hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/9b7c5797a4ac81296849f2c2fa5aa9e1/cf/b86bd757fdf94e38ac5ef58761f3397b 2023-07-15 16:12:38,090 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/88c6238f8097f3ef1058d488881fd8e7/cf/b497f3f474be4a1bb1aa59ca3821962d to hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/88c6238f8097f3ef1058d488881fd8e7/cf/b497f3f474be4a1bb1aa59ca3821962d 2023-07-15 16:12:38,094 DEBUG [HFileArchiver-16] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9b7c5797a4ac81296849f2c2fa5aa9e1/recovered.edits/9.seqid to hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/9b7c5797a4ac81296849f2c2fa5aa9e1/recovered.edits/9.seqid 2023-07-15 16:12:38,096 DEBUG [HFileArchiver-16] backup.HFileArchiver(596): Deleted hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9b7c5797a4ac81296849f2c2fa5aa9e1 2023-07-15 16:12:38,097 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/88c6238f8097f3ef1058d488881fd8e7/recovered.edits/9.seqid to hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/88c6238f8097f3ef1058d488881fd8e7/recovered.edits/9.seqid 2023-07-15 16:12:38,098 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/88c6238f8097f3ef1058d488881fd8e7 2023-07-15 16:12:38,098 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-15 16:12:38,101 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:38,104 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-07-15 16:12:38,106 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-07-15 16:12:38,107 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:38,107 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-07-15 16:12:38,108 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689437536308.88c6238f8097f3ef1058d488881fd8e7.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689437558107"}]},"ts":"9223372036854775807"} 2023-07-15 16:12:38,108 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689437536308.9b7c5797a4ac81296849f2c2fa5aa9e1.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689437558107"}]},"ts":"9223372036854775807"} 2023-07-15 16:12:38,109 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-15 16:12:38,109 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 88c6238f8097f3ef1058d488881fd8e7, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689437536308.88c6238f8097f3ef1058d488881fd8e7.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 9b7c5797a4ac81296849f2c2fa5aa9e1, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689437536308.9b7c5797a4ac81296849f2c2fa5aa9e1.', STARTKEY => '1', ENDKEY => ''}] 2023-07-15 16:12:38,109 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-07-15 16:12:38,109 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689437558109"}]},"ts":"9223372036854775807"} 2023-07-15 16:12:38,112 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-07-15 16:12:38,113 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:38,119 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 52 msec 2023-07-15 16:12:38,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-15 16:12:38,179 INFO [Listener at jenkins-hbase4.apache.org/42699] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-07-15 16:12:38,197 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-15 16:12:38,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:38,203 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-15 16:12:38,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:38,207 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-07-15 16:12:38,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:38,248 INFO [Listener at jenkins-hbase4.apache.org/42699] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=759 (was 747) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-127961896_17 at /127.0.0.1:55466 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x606da78-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x606da78-shared-pool-28 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x606da78-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x606da78-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x606da78-shared-pool-29 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-3947 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1709359519_1 at /127.0.0.1:55216 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1012686161) connection to jenkins-hbase4.apache.org/172.31.14.131:33209 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-127961896_17 at /127.0.0.1:40832 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x606da78-shared-pool-27 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-127961896_17 at /127.0.0.1:55248 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=901 (was 887) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=648 (was 562) - SystemLoadAverage LEAK? -, ProcessCount=187 (was 185) - ProcessCount LEAK? -, AvailableMemoryMB=2015 (was 2754) 2023-07-15 16:12:38,248 WARN [Listener at jenkins-hbase4.apache.org/42699] hbase.ResourceChecker(130): Thread=759 is superior to 500 2023-07-15 16:12:38,292 INFO [Listener at jenkins-hbase4.apache.org/42699] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testEmptyExportFileSystemState Thread=759, OpenFileDescriptor=901, MaxFileDescriptor=60000, SystemLoadAverage=648, ProcessCount=185, AvailableMemoryMB=2365 2023-07-15 16:12:38,292 WARN [Listener at jenkins-hbase4.apache.org/42699] hbase.ResourceChecker(130): Thread=759 is superior to 500 2023-07-15 16:12:38,294 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-15 16:12:38,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] procedure2.ProcedureExecutor(1029): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-15 16:12:38,298 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-15 16:12:38,299 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-07-15 16:12:38,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-15 16:12:38,303 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-15 16:12:38,306 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testEmptyExportFileSystemState/f69e92a6bf43512e4624a8ec75ac7e43 2023-07-15 16:12:38,306 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testEmptyExportFileSystemState/1ee93900529301daa05c34606f9c1a90 2023-07-15 16:12:38,307 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testEmptyExportFileSystemState/1ee93900529301daa05c34606f9c1a90 empty. 2023-07-15 16:12:38,307 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testEmptyExportFileSystemState/f69e92a6bf43512e4624a8ec75ac7e43 empty. 2023-07-15 16:12:38,307 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testEmptyExportFileSystemState/1ee93900529301daa05c34606f9c1a90 2023-07-15 16:12:38,307 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testEmptyExportFileSystemState/f69e92a6bf43512e4624a8ec75ac7e43 2023-07-15 16:12:38,307 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-15 16:12:38,333 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-15 16:12:38,334 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => f69e92a6bf43512e4624a8ec75ac7e43, NAME => 'testtb-testEmptyExportFileSystemState,,1689437558293.f69e92a6bf43512e4624a8ec75ac7e43.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp 2023-07-15 16:12:38,335 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 1ee93900529301daa05c34606f9c1a90, NAME => 'testtb-testEmptyExportFileSystemState,1,1689437558293.1ee93900529301daa05c34606f9c1a90.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp 2023-07-15 16:12:38,378 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689437558293.1ee93900529301daa05c34606f9c1a90.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 16:12:38,378 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 1ee93900529301daa05c34606f9c1a90, disabling compactions & flushes 2023-07-15 16:12:38,379 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689437558293.1ee93900529301daa05c34606f9c1a90. 2023-07-15 16:12:38,379 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689437558293.1ee93900529301daa05c34606f9c1a90. 2023-07-15 16:12:38,379 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689437558293.1ee93900529301daa05c34606f9c1a90. after waiting 0 ms 2023-07-15 16:12:38,379 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689437558293.1ee93900529301daa05c34606f9c1a90. 2023-07-15 16:12:38,379 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689437558293.1ee93900529301daa05c34606f9c1a90. 2023-07-15 16:12:38,379 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 1ee93900529301daa05c34606f9c1a90: 2023-07-15 16:12:38,380 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689437558293.f69e92a6bf43512e4624a8ec75ac7e43.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 16:12:38,380 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing f69e92a6bf43512e4624a8ec75ac7e43, disabling compactions & flushes 2023-07-15 16:12:38,380 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689437558293.f69e92a6bf43512e4624a8ec75ac7e43. 2023-07-15 16:12:38,380 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689437558293.f69e92a6bf43512e4624a8ec75ac7e43. 2023-07-15 16:12:38,380 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689437558293.f69e92a6bf43512e4624a8ec75ac7e43. after waiting 0 ms 2023-07-15 16:12:38,380 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689437558293.f69e92a6bf43512e4624a8ec75ac7e43. 2023-07-15 16:12:38,380 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689437558293.f69e92a6bf43512e4624a8ec75ac7e43. 2023-07-15 16:12:38,380 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for f69e92a6bf43512e4624a8ec75ac7e43: 2023-07-15 16:12:38,382 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-15 16:12:38,383 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689437558293.1ee93900529301daa05c34606f9c1a90.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689437558383"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689437558383"}]},"ts":"1689437558383"} 2023-07-15 16:12:38,383 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689437558293.f69e92a6bf43512e4624a8ec75ac7e43.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689437558383"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689437558383"}]},"ts":"1689437558383"} 2023-07-15 16:12:38,385 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-15 16:12:38,386 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-15 16:12:38,386 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689437558386"}]},"ts":"1689437558386"} 2023-07-15 16:12:38,388 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-07-15 16:12:38,391 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-15 16:12:38,392 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-15 16:12:38,392 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-15 16:12:38,392 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-15 16:12:38,392 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-15 16:12:38,393 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f69e92a6bf43512e4624a8ec75ac7e43, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=1ee93900529301daa05c34606f9c1a90, ASSIGN}] 2023-07-15 16:12:38,396 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f69e92a6bf43512e4624a8ec75ac7e43, ASSIGN 2023-07-15 16:12:38,396 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=1ee93900529301daa05c34606f9c1a90, ASSIGN 2023-07-15 16:12:38,398 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f69e92a6bf43512e4624a8ec75ac7e43, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45149,1689437455062; forceNewPlan=false, retain=false 2023-07-15 16:12:38,398 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=1ee93900529301daa05c34606f9c1a90, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43103,1689437454905; forceNewPlan=false, retain=false 2023-07-15 16:12:38,401 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-15 16:12:38,548 INFO [jenkins-hbase4:37255] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-15 16:12:38,551 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=1ee93900529301daa05c34606f9c1a90, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:38,551 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=f69e92a6bf43512e4624a8ec75ac7e43, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:38,551 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689437558293.1ee93900529301daa05c34606f9c1a90.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689437558551"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689437558551"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689437558551"}]},"ts":"1689437558551"} 2023-07-15 16:12:38,552 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689437558293.f69e92a6bf43512e4624a8ec75ac7e43.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689437558551"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689437558551"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689437558551"}]},"ts":"1689437558551"} 2023-07-15 16:12:38,554 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=92, state=RUNNABLE; OpenRegionProcedure 1ee93900529301daa05c34606f9c1a90, server=jenkins-hbase4.apache.org,43103,1689437454905}] 2023-07-15 16:12:38,555 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; OpenRegionProcedure f69e92a6bf43512e4624a8ec75ac7e43, server=jenkins-hbase4.apache.org,45149,1689437455062}] 2023-07-15 16:12:38,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-15 16:12:38,709 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1689437558293.1ee93900529301daa05c34606f9c1a90. 2023-07-15 16:12:38,710 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1ee93900529301daa05c34606f9c1a90, NAME => 'testtb-testEmptyExportFileSystemState,1,1689437558293.1ee93900529301daa05c34606f9c1a90.', STARTKEY => '1', ENDKEY => ''} 2023-07-15 16:12:38,710 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1689437558293.1ee93900529301daa05c34606f9c1a90. service=AccessControlService 2023-07-15 16:12:38,710 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 16:12:38,710 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 1ee93900529301daa05c34606f9c1a90 2023-07-15 16:12:38,711 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689437558293.1ee93900529301daa05c34606f9c1a90.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 16:12:38,711 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1ee93900529301daa05c34606f9c1a90 2023-07-15 16:12:38,711 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1ee93900529301daa05c34606f9c1a90 2023-07-15 16:12:38,712 INFO [StoreOpener-1ee93900529301daa05c34606f9c1a90-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 1ee93900529301daa05c34606f9c1a90 2023-07-15 16:12:38,717 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1689437558293.f69e92a6bf43512e4624a8ec75ac7e43. 2023-07-15 16:12:38,717 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f69e92a6bf43512e4624a8ec75ac7e43, NAME => 'testtb-testEmptyExportFileSystemState,,1689437558293.f69e92a6bf43512e4624a8ec75ac7e43.', STARTKEY => '', ENDKEY => '1'} 2023-07-15 16:12:38,717 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1689437558293.f69e92a6bf43512e4624a8ec75ac7e43. service=AccessControlService 2023-07-15 16:12:38,717 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 16:12:38,718 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState f69e92a6bf43512e4624a8ec75ac7e43 2023-07-15 16:12:38,718 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689437558293.f69e92a6bf43512e4624a8ec75ac7e43.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 16:12:38,718 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f69e92a6bf43512e4624a8ec75ac7e43 2023-07-15 16:12:38,718 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f69e92a6bf43512e4624a8ec75ac7e43 2023-07-15 16:12:38,719 INFO [StoreOpener-f69e92a6bf43512e4624a8ec75ac7e43-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region f69e92a6bf43512e4624a8ec75ac7e43 2023-07-15 16:12:38,720 DEBUG [StoreOpener-f69e92a6bf43512e4624a8ec75ac7e43-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testEmptyExportFileSystemState/f69e92a6bf43512e4624a8ec75ac7e43/cf 2023-07-15 16:12:38,720 DEBUG [StoreOpener-f69e92a6bf43512e4624a8ec75ac7e43-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testEmptyExportFileSystemState/f69e92a6bf43512e4624a8ec75ac7e43/cf 2023-07-15 16:12:38,721 INFO [StoreOpener-f69e92a6bf43512e4624a8ec75ac7e43-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f69e92a6bf43512e4624a8ec75ac7e43 columnFamilyName cf 2023-07-15 16:12:38,721 INFO [StoreOpener-f69e92a6bf43512e4624a8ec75ac7e43-1] regionserver.HStore(310): Store=f69e92a6bf43512e4624a8ec75ac7e43/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 16:12:38,722 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testEmptyExportFileSystemState/f69e92a6bf43512e4624a8ec75ac7e43 2023-07-15 16:12:38,723 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testEmptyExportFileSystemState/f69e92a6bf43512e4624a8ec75ac7e43 2023-07-15 16:12:38,723 DEBUG [StoreOpener-1ee93900529301daa05c34606f9c1a90-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testEmptyExportFileSystemState/1ee93900529301daa05c34606f9c1a90/cf 2023-07-15 16:12:38,723 DEBUG [StoreOpener-1ee93900529301daa05c34606f9c1a90-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testEmptyExportFileSystemState/1ee93900529301daa05c34606f9c1a90/cf 2023-07-15 16:12:38,724 INFO [StoreOpener-1ee93900529301daa05c34606f9c1a90-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1ee93900529301daa05c34606f9c1a90 columnFamilyName cf 2023-07-15 16:12:38,724 INFO [StoreOpener-1ee93900529301daa05c34606f9c1a90-1] regionserver.HStore(310): Store=1ee93900529301daa05c34606f9c1a90/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 16:12:38,731 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testEmptyExportFileSystemState/1ee93900529301daa05c34606f9c1a90 2023-07-15 16:12:38,732 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testEmptyExportFileSystemState/1ee93900529301daa05c34606f9c1a90 2023-07-15 16:12:38,734 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f69e92a6bf43512e4624a8ec75ac7e43 2023-07-15 16:12:38,736 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1ee93900529301daa05c34606f9c1a90 2023-07-15 16:12:38,737 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testEmptyExportFileSystemState/f69e92a6bf43512e4624a8ec75ac7e43/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 16:12:38,738 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f69e92a6bf43512e4624a8ec75ac7e43; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70426289, jitterRate=0.04943348467350006}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 16:12:38,738 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f69e92a6bf43512e4624a8ec75ac7e43: 2023-07-15 16:12:38,738 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1689437558293.f69e92a6bf43512e4624a8ec75ac7e43., pid=94, masterSystemTime=1689437558709 2023-07-15 16:12:38,739 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testEmptyExportFileSystemState/1ee93900529301daa05c34606f9c1a90/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 16:12:38,739 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1ee93900529301daa05c34606f9c1a90; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70247828, jitterRate=0.046774208545684814}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 16:12:38,739 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1ee93900529301daa05c34606f9c1a90: 2023-07-15 16:12:38,740 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1689437558293.1ee93900529301daa05c34606f9c1a90., pid=93, masterSystemTime=1689437558706 2023-07-15 16:12:38,742 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=f69e92a6bf43512e4624a8ec75ac7e43, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:38,742 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1689437558293.f69e92a6bf43512e4624a8ec75ac7e43.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689437558742"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689437558742"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689437558742"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689437558742"}]},"ts":"1689437558742"} 2023-07-15 16:12:38,743 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1689437558293.1ee93900529301daa05c34606f9c1a90. 2023-07-15 16:12:38,743 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1689437558293.1ee93900529301daa05c34606f9c1a90. 2023-07-15 16:12:38,743 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=1ee93900529301daa05c34606f9c1a90, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:38,743 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1689437558293.1ee93900529301daa05c34606f9c1a90.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689437558743"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689437558743"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689437558743"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689437558743"}]},"ts":"1689437558743"} 2023-07-15 16:12:38,745 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1689437558293.f69e92a6bf43512e4624a8ec75ac7e43. 2023-07-15 16:12:38,745 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1689437558293.f69e92a6bf43512e4624a8ec75ac7e43. 2023-07-15 16:12:38,753 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=91 2023-07-15 16:12:38,753 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=91, state=SUCCESS; OpenRegionProcedure f69e92a6bf43512e4624a8ec75ac7e43, server=jenkins-hbase4.apache.org,45149,1689437455062 in 197 msec 2023-07-15 16:12:38,754 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=92 2023-07-15 16:12:38,754 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=92, state=SUCCESS; OpenRegionProcedure 1ee93900529301daa05c34606f9c1a90, server=jenkins-hbase4.apache.org,43103,1689437454905 in 199 msec 2023-07-15 16:12:38,755 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f69e92a6bf43512e4624a8ec75ac7e43, ASSIGN in 360 msec 2023-07-15 16:12:38,756 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=92, resume processing ppid=90 2023-07-15 16:12:38,756 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=1ee93900529301daa05c34606f9c1a90, ASSIGN in 361 msec 2023-07-15 16:12:38,756 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-15 16:12:38,757 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689437558757"}]},"ts":"1689437558757"} 2023-07-15 16:12:38,758 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-07-15 16:12:38,760 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-15 16:12:38,760 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-07-15 16:12:38,762 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43103] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-15 16:12:38,764 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 16:12:38,764 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 16:12:38,764 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 16:12:38,765 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 16:12:38,766 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-15 16:12:38,766 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-15 16:12:38,766 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-15 16:12:38,766 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-15 16:12:38,767 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 472 msec 2023-07-15 16:12:38,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-15 16:12:38,903 INFO [Listener at jenkins-hbase4.apache.org/42699] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-07-15 16:12:38,903 DEBUG [Listener at jenkins-hbase4.apache.org/42699] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testEmptyExportFileSystemState get assigned. Timeout = 60000ms 2023-07-15 16:12:38,904 INFO [Listener at jenkins-hbase4.apache.org/42699] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 16:12:38,907 INFO [Listener at jenkins-hbase4.apache.org/42699] hbase.HBaseTestingUtility(3484): All regions for table testtb-testEmptyExportFileSystemState assigned to meta. Checking AM states. 2023-07-15 16:12:38,907 INFO [Listener at jenkins-hbase4.apache.org/42699] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 16:12:38,907 INFO [Listener at jenkins-hbase4.apache.org/42699] hbase.HBaseTestingUtility(3504): All regions for table testtb-testEmptyExportFileSystemState assigned. 2023-07-15 16:12:38,910 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-15 16:12:38,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689437558910 (current time:1689437558910). 2023-07-15 16:12:38,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 16:12:38,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] zookeeper.ReadOnlyZKClient(139): Connect 0x1f895422 to 127.0.0.1:58438 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 16:12:38,917 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@611c8d48, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 16:12:38,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 16:12:38,924 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34042, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 16:12:38,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1f895422 to 127.0.0.1:58438 2023-07-15 16:12:38,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 16:12:38,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] zookeeper.ReadOnlyZKClient(139): Connect 0x26e73797 to 127.0.0.1:58438 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 16:12:38,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@731a4f2d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 16:12:38,938 DEBUG [hconnection-0x76e9facb-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 16:12:38,939 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34050, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 16:12:38,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x26e73797 to 127.0.0.1:58438 2023-07-15 16:12:38,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 16:12:38,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-15 16:12:38,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 16:12:38,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-15 16:12:38,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-15 16:12:38,950 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-15 16:12:38,951 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689438158951 2023-07-15 16:12:38,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-15 16:12:38,951 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-15 16:12:38,952 DEBUG [Listener at jenkins-hbase4.apache.org/42699] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 16:12:38,952 DEBUG [Listener at jenkins-hbase4.apache.org/42699] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 16:12:38,956 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-15 16:12:38,958 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-15 16:12:38,958 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 8 msec 2023-07-15 16:12:38,963 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-15 16:12:38,963 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689438158963 2023-07-15 16:12:38,986 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:38,987 INFO [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-07-15 16:12:38,987 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 16:12:38,988 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-15 16:12:38,988 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-15 16:12:38,989 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:38,989 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:38,994 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:12:38,994 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:12:38,994 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:12:38,994 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:38,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:12:38,994 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:12:38,994 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:12:38,995 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:12:38,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:12:38,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:12:38,995 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:38,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:38,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:38,995 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:38,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:38,995 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:38,995 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:38,996 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:38,996 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 16:12:38,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-15 16:12:38,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:38,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-15 16:12:38,996 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:38,996 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-15 16:12:38,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:38,996 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-15 16:12:38,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-15 16:12:38,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:38,996 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:38,997 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-15 16:12:38,997 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-15 16:12:38,997 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 16:12:38,998 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,000 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,000 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-15 16:12:39,000 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-15 16:12:39,000 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 16:12:39,000 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-15 16:12:39,002 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-15 16:12:39,002 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-15 16:12:39,000 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 16:12:39,002 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35773,1689437454990' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-15 16:12:39,002 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-15 16:12:39,003 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-15 16:12:39,003 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-15 16:12:39,003 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45149,1689437455062' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-15 16:12:39,003 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43103,1689437454905' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-15 16:12:39,005 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:39,005 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:39,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:12:39,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:12:39,005 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,005 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:39,005 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,005 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,005 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:12:39,005 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 16:12:39,006 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 16:12:39,006 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,006 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 16:12:39,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:12:39,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:39,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:12:39,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:39,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:12:39,007 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45149,1689437455062' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-15 16:12:39,007 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@10f36c78[Count = 1] remaining members to acquire global barrier 2023-07-15 16:12:39,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:39,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:12:39,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:12:39,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:12:39,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:12:39,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:39,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:12:39,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:39,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:12:39,010 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43103,1689437454905' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-15 16:12:39,010 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@10f36c78[Count = 0] remaining members to acquire global barrier 2023-07-15 16:12:39,010 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-15 16:12:39,010 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,011 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,011 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,011 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,011 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,011 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,011 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,011 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-15 16:12:39,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,011 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-15 16:12:39,011 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-15 16:12:39,011 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 16:12:39,011 DEBUG [rs(jenkins-hbase4.apache.org,45149,1689437455062)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689437558293.f69e92a6bf43512e4624a8ec75ac7e43. 2023-07-15 16:12:39,011 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-15 16:12:39,011 DEBUG [rs(jenkins-hbase4.apache.org,45149,1689437455062)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689437558293.f69e92a6bf43512e4624a8ec75ac7e43. started... 2023-07-15 16:12:39,011 DEBUG [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689437558293.1ee93900529301daa05c34606f9c1a90. 2023-07-15 16:12:39,011 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35773,1689437454990' in zk 2023-07-15 16:12:39,012 DEBUG [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689437558293.1ee93900529301daa05c34606f9c1a90. started... 2023-07-15 16:12:39,011 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 16:12:39,011 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:39,013 DEBUG [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 1ee93900529301daa05c34606f9c1a90: 2023-07-15 16:12:39,011 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 16:12:39,014 DEBUG [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689437558293.1ee93900529301daa05c34606f9c1a90.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,014 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:39,014 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 16:12:39,013 DEBUG [rs(jenkins-hbase4.apache.org,45149,1689437455062)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f69e92a6bf43512e4624a8ec75ac7e43: 2023-07-15 16:12:39,012 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 16:12:39,014 DEBUG [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 16:12:39,014 DEBUG [rs(jenkins-hbase4.apache.org,45149,1689437455062)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689437558293.f69e92a6bf43512e4624a8ec75ac7e43.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,014 DEBUG [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-15 16:12:39,014 DEBUG [rs(jenkins-hbase4.apache.org,45149,1689437455062)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 16:12:39,014 DEBUG [rs(jenkins-hbase4.apache.org,45149,1689437455062)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-15 16:12:39,016 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-15 16:12:39,016 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 16:12:39,016 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-15 16:12:39,046 DEBUG [rs(jenkins-hbase4.apache.org,45149,1689437455062)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689437558293.f69e92a6bf43512e4624a8ec75ac7e43. completed. 2023-07-15 16:12:39,047 DEBUG [rs(jenkins-hbase4.apache.org,45149,1689437455062)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689437558293.f69e92a6bf43512e4624a8ec75ac7e43. 2023-07-15 16:12:39,047 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 16:12:39,047 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 16:12:39,047 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:39,047 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-15 16:12:39,047 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45149,1689437455062' in zk 2023-07-15 16:12:39,049 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-15 16:12:39,049 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:39,049 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 16:12:39,049 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-15 16:12:39,050 DEBUG [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689437558293.1ee93900529301daa05c34606f9c1a90. completed. 2023-07-15 16:12:39,050 DEBUG [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689437558293.1ee93900529301daa05c34606f9c1a90. 2023-07-15 16:12:39,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:39,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:12:39,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:12:39,052 DEBUG [Listener at jenkins-hbase4.apache.org/42699] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 16:12:39,052 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 16:12:39,052 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 16:12:39,052 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:39,052 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-15 16:12:39,052 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43103,1689437454905' in zk 2023-07-15 16:12:39,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:12:39,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-15 16:12:39,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-15 16:12:39,053 DEBUG [Listener at jenkins-hbase4.apache.org/42699] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 16:12:39,054 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:39,054 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-15 16:12:39,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:12:39,054 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 16:12:39,054 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-15 16:12:39,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:39,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:12:39,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:39,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:12:39,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:12:39,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:39,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:39,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,45149,1689437455062': 2023-07-15 16:12:39,060 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45149,1689437455062' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-15 16:12:39,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:39,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:12:39,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:12:39,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:12:39,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:12:39,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:39,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:12:39,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:39,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:12:39,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:12:39,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:39,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:39,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,43103,1689437454905': 2023-07-15 16:12:39,064 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43103,1689437454905' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-15 16:12:39,064 INFO [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-07-15 16:12:39,064 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 16:12:39,064 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 16:12:39,064 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,064 INFO [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 16:12:39,067 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,067 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,067 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,067 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,067 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:12:39,067 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:12:39,067 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,067 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,067 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:12:39,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:12:39,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:12:39,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:12:39,067 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,067 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:12:39,068 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:39,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:12:39,068 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:12:39,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,068 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:12:39,068 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:12:39,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:12:39,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:12:39,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,069 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:39,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:12:39,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:39,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:12:39,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:39,071 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:12:39,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:12:39,071 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:39,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,071 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:39,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:12:39,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:39,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:39,075 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:12:39,075 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:39,075 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:12:39,075 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:12:39,075 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:12:39,075 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:12:39,075 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:12:39,075 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:12:39,075 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:12:39,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:12:39,075 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,075 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:12:39,075 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,076 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:12:39,076 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:39,076 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,076 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:39,076 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,076 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:39,076 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:12:39,076 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,076 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,075 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 16:12:39,075 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:12:39,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:12:39,078 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:12:39,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:12:39,076 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:12:39,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:12:39,078 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:12:39,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:12:39,079 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,115 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,150 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-15 16:12:39,150 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,151 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,151 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689437558951Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689437559075 (+124 ms)Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1689437559075Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1689437559085 (+10 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689437559107 (+22 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689437559150 (+43 ms) 2023-07-15 16:12:39,155 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-15 16:12:39,160 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 200 msec 2023-07-15 16:12:39,254 DEBUG [Listener at jenkins-hbase4.apache.org/42699] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 16:12:39,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-15 16:12:39,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 16:12:39,264 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45149] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1689437558293.f69e92a6bf43512e4624a8ec75ac7e43. with WAL disabled. Data may be lost in the event of a crash. 2023-07-15 16:12:39,265 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43103] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1689437558293.1ee93900529301daa05c34606f9c1a90. with WAL disabled. Data may be lost in the event of a crash. 2023-07-15 16:12:39,268 DEBUG [Listener at jenkins-hbase4.apache.org/42699] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-15 16:12:39,269 DEBUG [Listener at jenkins-hbase4.apache.org/42699] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689437558293.f69e92a6bf43512e4624a8ec75ac7e43. 2023-07-15 16:12:39,269 INFO [Listener at jenkins-hbase4.apache.org/42699] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 16:12:39,291 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-15 16:12:39,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689437559291 (current time:1689437559291). 2023-07-15 16:12:39,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 16:12:39,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] zookeeper.ReadOnlyZKClient(139): Connect 0x38899428 to 127.0.0.1:58438 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 16:12:39,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@10f1e50, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 16:12:39,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 16:12:39,308 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34054, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 16:12:39,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x38899428 to 127.0.0.1:58438 2023-07-15 16:12:39,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 16:12:39,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] zookeeper.ReadOnlyZKClient(139): Connect 0x38546fcc to 127.0.0.1:58438 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 16:12:39,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4c88843a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 16:12:39,323 DEBUG [hconnection-0x350cee65-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 16:12:39,325 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34070, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 16:12:39,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x38546fcc to 127.0.0.1:58438 2023-07-15 16:12:39,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 16:12:39,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-15 16:12:39,331 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 16:12:39,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-15 16:12:39,335 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-15 16:12:39,336 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-15 16:12:39,337 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689438159337 2023-07-15 16:12:39,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-15 16:12:39,337 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-15 16:12:39,339 DEBUG [Listener at jenkins-hbase4.apache.org/42699] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 16:12:39,339 DEBUG [Listener at jenkins-hbase4.apache.org/42699] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 16:12:39,339 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-15 16:12:39,340 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-15 16:12:39,341 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-07-15 16:12:39,342 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-15 16:12:39,343 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689438159343 2023-07-15 16:12:39,362 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,363 INFO [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-07-15 16:12:39,363 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 16:12:39,364 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-15 16:12:39,364 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-15 16:12:39,365 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,365 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,366 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:12:39,366 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:12:39,366 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:12:39,366 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:12:39,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:12:39,366 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:39,366 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:12:39,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:12:39,366 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:12:39,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:12:39,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,367 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:39,367 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:39,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,367 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,367 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,367 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:39,367 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 16:12:39,367 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-15 16:12:39,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-15 16:12:39,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,367 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-15 16:12:39,367 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-15 16:12:39,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-15 16:12:39,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,368 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-15 16:12:39,368 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,368 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,368 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-15 16:12:39,368 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-15 16:12:39,368 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 16:12:39,368 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 16:12:39,369 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-15 16:12:39,370 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-15 16:12:39,370 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-15 16:12:39,370 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43103,1689437454905' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-15 16:12:39,368 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,370 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-15 16:12:39,371 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45149,1689437455062' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-15 16:12:39,371 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-15 16:12:39,371 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 16:12:39,374 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-15 16:12:39,374 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-15 16:12:39,374 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35773,1689437454990' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-15 16:12:39,375 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,375 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:39,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:39,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:12:39,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:12:39,376 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:39,376 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,377 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,378 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:12:39,378 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,378 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 16:12:39,378 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 16:12:39,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:12:39,378 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,378 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 16:12:39,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:39,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:12:39,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:39,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:12:39,380 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43103,1689437454905' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-15 16:12:39,380 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3f1a686f[Count = 1] remaining members to acquire global barrier 2023-07-15 16:12:39,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:39,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:12:39,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:12:39,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:12:39,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:12:39,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:39,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:12:39,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:39,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:12:39,382 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45149,1689437455062' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-15 16:12:39,382 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3f1a686f[Count = 0] remaining members to acquire global barrier 2023-07-15 16:12:39,382 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-15 16:12:39,382 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,386 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,386 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,386 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,386 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,386 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,386 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,386 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-15 16:12:39,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,386 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:39,387 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-15 16:12:39,387 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 16:12:39,387 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 16:12:39,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,387 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 16:12:39,387 DEBUG [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689437558293.1ee93900529301daa05c34606f9c1a90. 2023-07-15 16:12:39,387 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-15 16:12:39,387 DEBUG [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689437558293.1ee93900529301daa05c34606f9c1a90. started... 2023-07-15 16:12:39,387 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-15 16:12:39,387 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35773,1689437454990' in zk 2023-07-15 16:12:39,387 DEBUG [rs(jenkins-hbase4.apache.org,45149,1689437455062)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689437558293.f69e92a6bf43512e4624a8ec75ac7e43. 2023-07-15 16:12:39,387 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:39,387 DEBUG [rs(jenkins-hbase4.apache.org,45149,1689437455062)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689437558293.f69e92a6bf43512e4624a8ec75ac7e43. started... 2023-07-15 16:12:39,387 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 16:12:39,387 INFO [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 1ee93900529301daa05c34606f9c1a90 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-15 16:12:39,387 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 16:12:39,387 INFO [rs(jenkins-hbase4.apache.org,45149,1689437455062)-snapshot-pool-0] regionserver.HRegion(2745): Flushing f69e92a6bf43512e4624a8ec75ac7e43 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-15 16:12:39,388 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-15 16:12:39,388 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 16:12:39,388 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-15 16:12:39,407 INFO [rs(jenkins-hbase4.apache.org,45149,1689437455062)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=266 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testEmptyExportFileSystemState/f69e92a6bf43512e4624a8ec75ac7e43/.tmp/cf/5585cec9d7b94256a7b62103407ea7b6 2023-07-15 16:12:39,409 INFO [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.00 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testEmptyExportFileSystemState/1ee93900529301daa05c34606f9c1a90/.tmp/cf/6bd0bff1508845b19a168f6bb70a5266 2023-07-15 16:12:39,416 DEBUG [rs(jenkins-hbase4.apache.org,45149,1689437455062)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testEmptyExportFileSystemState/f69e92a6bf43512e4624a8ec75ac7e43/.tmp/cf/5585cec9d7b94256a7b62103407ea7b6 as hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testEmptyExportFileSystemState/f69e92a6bf43512e4624a8ec75ac7e43/cf/5585cec9d7b94256a7b62103407ea7b6 2023-07-15 16:12:39,419 DEBUG [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testEmptyExportFileSystemState/1ee93900529301daa05c34606f9c1a90/.tmp/cf/6bd0bff1508845b19a168f6bb70a5266 as hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testEmptyExportFileSystemState/1ee93900529301daa05c34606f9c1a90/cf/6bd0bff1508845b19a168f6bb70a5266 2023-07-15 16:12:39,423 INFO [rs(jenkins-hbase4.apache.org,45149,1689437455062)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testEmptyExportFileSystemState/f69e92a6bf43512e4624a8ec75ac7e43/cf/5585cec9d7b94256a7b62103407ea7b6, entries=4, sequenceid=6, filesize=5.1 K 2023-07-15 16:12:39,427 INFO [rs(jenkins-hbase4.apache.org,45149,1689437455062)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for f69e92a6bf43512e4624a8ec75ac7e43 in 40ms, sequenceid=6, compaction requested=false 2023-07-15 16:12:39,427 DEBUG [rs(jenkins-hbase4.apache.org,45149,1689437455062)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-15 16:12:39,427 INFO [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testEmptyExportFileSystemState/1ee93900529301daa05c34606f9c1a90/cf/6bd0bff1508845b19a168f6bb70a5266, entries=46, sequenceid=6, filesize=7.9 K 2023-07-15 16:12:39,428 DEBUG [rs(jenkins-hbase4.apache.org,45149,1689437455062)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f69e92a6bf43512e4624a8ec75ac7e43: 2023-07-15 16:12:39,428 DEBUG [rs(jenkins-hbase4.apache.org,45149,1689437455062)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689437558293.f69e92a6bf43512e4624a8ec75ac7e43.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,428 INFO [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 1ee93900529301daa05c34606f9c1a90 in 41ms, sequenceid=6, compaction requested=false 2023-07-15 16:12:39,428 DEBUG [rs(jenkins-hbase4.apache.org,45149,1689437455062)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 16:12:39,431 DEBUG [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 1ee93900529301daa05c34606f9c1a90: 2023-07-15 16:12:39,431 DEBUG [rs(jenkins-hbase4.apache.org,45149,1689437455062)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testEmptyExportFileSystemState/f69e92a6bf43512e4624a8ec75ac7e43/cf/5585cec9d7b94256a7b62103407ea7b6] hfiles 2023-07-15 16:12:39,431 DEBUG [rs(jenkins-hbase4.apache.org,45149,1689437455062)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testEmptyExportFileSystemState/f69e92a6bf43512e4624a8ec75ac7e43/cf/5585cec9d7b94256a7b62103407ea7b6 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,431 DEBUG [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689437558293.1ee93900529301daa05c34606f9c1a90.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,431 DEBUG [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 16:12:39,431 DEBUG [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testEmptyExportFileSystemState/1ee93900529301daa05c34606f9c1a90/cf/6bd0bff1508845b19a168f6bb70a5266] hfiles 2023-07-15 16:12:39,431 DEBUG [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testEmptyExportFileSystemState/1ee93900529301daa05c34606f9c1a90/cf/6bd0bff1508845b19a168f6bb70a5266 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,439 DEBUG [Listener at jenkins-hbase4.apache.org/42699] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 16:12:39,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-15 16:12:39,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-15 16:12:39,440 DEBUG [Listener at jenkins-hbase4.apache.org/42699] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 16:12:39,446 DEBUG [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689437558293.1ee93900529301daa05c34606f9c1a90. completed. 2023-07-15 16:12:39,446 DEBUG [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689437558293.1ee93900529301daa05c34606f9c1a90. 2023-07-15 16:12:39,446 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 16:12:39,446 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 16:12:39,446 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:39,446 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-15 16:12:39,447 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43103,1689437454905' in zk 2023-07-15 16:12:39,448 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-15 16:12:39,448 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:39,448 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 16:12:39,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:39,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:12:39,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:12:39,448 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-15 16:12:39,452 DEBUG [rs(jenkins-hbase4.apache.org,45149,1689437455062)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689437558293.f69e92a6bf43512e4624a8ec75ac7e43. completed. 2023-07-15 16:12:39,452 DEBUG [rs(jenkins-hbase4.apache.org,45149,1689437455062)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689437558293.f69e92a6bf43512e4624a8ec75ac7e43. 2023-07-15 16:12:39,452 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 16:12:39,452 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 16:12:39,452 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:39,452 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-15 16:12:39,452 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45149,1689437455062' in zk 2023-07-15 16:12:39,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:12:39,455 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:39,455 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-15 16:12:39,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:12:39,455 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 16:12:39,455 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-15 16:12:39,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:39,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:12:39,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:39,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:12:39,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:12:39,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:39,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:39,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,43103,1689437454905': 2023-07-15 16:12:39,460 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43103,1689437454905' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-15 16:12:39,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:39,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:12:39,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:12:39,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:12:39,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:12:39,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:39,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:12:39,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:39,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:12:39,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:12:39,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:39,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:39,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,45149,1689437455062': 2023-07-15 16:12:39,464 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45149,1689437455062' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-15 16:12:39,464 INFO [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-07-15 16:12:39,464 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 16:12:39,464 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 16:12:39,464 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,464 INFO [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 16:12:39,466 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,466 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,466 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,466 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:12:39,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:12:39,466 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,466 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:12:39,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,466 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,466 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:12:39,466 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,466 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:12:39,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,471 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:12:39,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:12:39,471 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:39,471 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:12:39,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:12:39,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:12:39,471 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:12:39,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:12:39,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,471 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:12:39,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,472 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:39,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:12:39,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:39,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:12:39,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:39,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:12:39,474 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:12:39,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,474 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:39,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:12:39,475 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:39,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:39,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:39,479 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:12:39,479 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:39,479 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:12:39,479 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,479 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:12:39,479 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:12:39,479 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,479 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 16:12:39,479 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:12:39,479 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:12:39,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:12:39,481 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:39,481 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:12:39,479 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:12:39,479 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,479 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:12:39,479 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:12:39,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:12:39,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:12:39,481 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,481 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:39,481 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,481 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:39,481 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:12:39,481 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:12:39,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:12:39,481 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,481 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,486 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:12:39,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:12:39,486 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:12:39,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:12:39,486 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,513 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,537 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-15 16:12:39,537 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,537 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,537 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689437559337Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1689437559479 (+142 ms)Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1689437559481 (+2 ms)Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1689437559493 (+12 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1689437559504 (+11 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689437559537 (+33 ms) 2023-07-15 16:12:39,542 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-15 16:12:39,544 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 204 msec 2023-07-15 16:12:39,640 DEBUG [Listener at jenkins-hbase4.apache.org/42699] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 16:12:39,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-15 16:12:39,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 16:12:39,642 INFO [Listener at jenkins-hbase4.apache.org/42699] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/export-test/export-1689437559642 2023-07-15 16:12:39,642 INFO [Listener at jenkins-hbase4.apache.org/42699] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:44749, tgtDir=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/export-test/export-1689437559642, rawTgtDir=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/export-test/export-1689437559642, srcFsUri=hdfs://localhost:44749, srcDir=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8 2023-07-15 16:12:39,673 DEBUG [Listener at jenkins-hbase4.apache.org/42699] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44749, inputRoot=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8 2023-07-15 16:12:39,673 DEBUG [Listener at jenkins-hbase4.apache.org/42699] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1166559959_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/export-test/export-1689437559642, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/export-test/export-1689437559642/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,673 INFO [Listener at jenkins-hbase4.apache.org/42699] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44749, inputRoot=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8, snapshotDir=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-07-15 16:12:39,679 INFO [Listener at jenkins-hbase4.apache.org/42699] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/export-test/export-1689437559642/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:39,731 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-15 16:12:39,731 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-15 16:12:39,732 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-15 16:12:39,732 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-15 16:12:40,866 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1587f29c-5daf-234a-1773-5088522b715e/hadoop-6034964505712956062.jar 2023-07-15 16:12:40,867 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-15 16:12:40,868 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-15 16:12:40,957 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1587f29c-5daf-234a-1773-5088522b715e/hadoop-2113552908625849197.jar 2023-07-15 16:12:40,957 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-15 16:12:40,958 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-15 16:12:40,958 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-15 16:12:40,959 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-15 16:12:40,959 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-15 16:12:40,960 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-15 16:12:40,961 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-15 16:12:40,961 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-15 16:12:40,962 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-15 16:12:40,962 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-15 16:12:40,963 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-15 16:12:40,964 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-15 16:12:40,964 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-15 16:12:40,964 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-15 16:12:40,965 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-15 16:12:40,966 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-15 16:12:40,966 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 16:12:40,967 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 16:12:40,967 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 16:12:40,968 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 16:12:40,968 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 16:12:40,969 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 16:12:40,970 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 16:12:41,238 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689437464006_0005_000001 (auth:SIMPLE) 2023-07-15 16:12:42,561 WARN [Listener at jenkins-hbase4.apache.org/42699] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-15 16:12:42,564 INFO [Listener at jenkins-hbase4.apache.org/42699] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-07-15 16:12:42,790 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-15 16:12:43,064 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 16:12:43,064 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 16:12:43,245 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689437464006_0006_000001 (auth:SIMPLE) 2023-07-15 16:12:49,265 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689437464006_0006_000001 (auth:SIMPLE) 2023-07-15 16:12:52,405 INFO [Listener at jenkins-hbase4.apache.org/42699] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-15 16:12:52,407 INFO [Listener at jenkins-hbase4.apache.org/42699] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-15 16:12:52,423 INFO [Listener at jenkins-hbase4.apache.org/42699] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:52,423 INFO [Listener at jenkins-hbase4.apache.org/42699] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-15 16:12:52,424 INFO [Listener at jenkins-hbase4.apache.org/42699] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-15 16:12:52,424 DEBUG [Listener at jenkins-hbase4.apache.org/42699] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-127961896_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:52,424 DEBUG [Listener at jenkins-hbase4.apache.org/42699] snapshot.TestExportSnapshot(367): hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-15 16:12:52,425 DEBUG [Listener at jenkins-hbase4.apache.org/42699] snapshot.TestExportSnapshot(367): hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-15 16:12:52,425 DEBUG [Listener at jenkins-hbase4.apache.org/42699] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-127961896_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/export-test/export-1689437559642/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/export-test/export-1689437559642/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:52,425 DEBUG [Listener at jenkins-hbase4.apache.org/42699] snapshot.TestExportSnapshot(367): hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/export-test/export-1689437559642/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-15 16:12:52,425 DEBUG [Listener at jenkins-hbase4.apache.org/42699] snapshot.TestExportSnapshot(367): hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/export-test/export-1689437559642/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-15 16:12:52,433 INFO [Listener at jenkins-hbase4.apache.org/42699] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-07-15 16:12:52,433 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-07-15 16:12:52,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] procedure2.ProcedureExecutor(1029): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-15 16:12:52,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-15 16:12:52,440 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689437572440"}]},"ts":"1689437572440"} 2023-07-15 16:12:52,441 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-07-15 16:12:52,443 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-07-15 16:12:52,444 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f69e92a6bf43512e4624a8ec75ac7e43, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=1ee93900529301daa05c34606f9c1a90, UNASSIGN}] 2023-07-15 16:12:52,446 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f69e92a6bf43512e4624a8ec75ac7e43, UNASSIGN 2023-07-15 16:12:52,447 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=1ee93900529301daa05c34606f9c1a90, UNASSIGN 2023-07-15 16:12:52,447 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=f69e92a6bf43512e4624a8ec75ac7e43, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:52,447 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689437558293.f69e92a6bf43512e4624a8ec75ac7e43.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689437572447"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689437572447"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689437572447"}]},"ts":"1689437572447"} 2023-07-15 16:12:52,448 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=1ee93900529301daa05c34606f9c1a90, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:52,449 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689437558293.1ee93900529301daa05c34606f9c1a90.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689437572448"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689437572448"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689437572448"}]},"ts":"1689437572448"} 2023-07-15 16:12:52,450 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; CloseRegionProcedure f69e92a6bf43512e4624a8ec75ac7e43, server=jenkins-hbase4.apache.org,45149,1689437455062}] 2023-07-15 16:12:52,451 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=101, state=RUNNABLE; CloseRegionProcedure 1ee93900529301daa05c34606f9c1a90, server=jenkins-hbase4.apache.org,43103,1689437454905}] 2023-07-15 16:12:52,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-15 16:12:52,602 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close f69e92a6bf43512e4624a8ec75ac7e43 2023-07-15 16:12:52,602 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f69e92a6bf43512e4624a8ec75ac7e43, disabling compactions & flushes 2023-07-15 16:12:52,602 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689437558293.f69e92a6bf43512e4624a8ec75ac7e43. 2023-07-15 16:12:52,602 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689437558293.f69e92a6bf43512e4624a8ec75ac7e43. 2023-07-15 16:12:52,602 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689437558293.f69e92a6bf43512e4624a8ec75ac7e43. after waiting 0 ms 2023-07-15 16:12:52,602 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689437558293.f69e92a6bf43512e4624a8ec75ac7e43. 2023-07-15 16:12:52,605 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 1ee93900529301daa05c34606f9c1a90 2023-07-15 16:12:52,606 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1ee93900529301daa05c34606f9c1a90, disabling compactions & flushes 2023-07-15 16:12:52,606 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689437558293.1ee93900529301daa05c34606f9c1a90. 2023-07-15 16:12:52,606 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689437558293.1ee93900529301daa05c34606f9c1a90. 2023-07-15 16:12:52,606 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689437558293.1ee93900529301daa05c34606f9c1a90. after waiting 0 ms 2023-07-15 16:12:52,606 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689437558293.1ee93900529301daa05c34606f9c1a90. 2023-07-15 16:12:52,642 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testEmptyExportFileSystemState/f69e92a6bf43512e4624a8ec75ac7e43/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 16:12:52,643 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testEmptyExportFileSystemState/1ee93900529301daa05c34606f9c1a90/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 16:12:52,643 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 16:12:52,645 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689437558293.f69e92a6bf43512e4624a8ec75ac7e43. 2023-07-15 16:12:52,645 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f69e92a6bf43512e4624a8ec75ac7e43: 2023-07-15 16:12:52,645 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 16:12:52,646 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689437558293.1ee93900529301daa05c34606f9c1a90. 2023-07-15 16:12:52,646 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1ee93900529301daa05c34606f9c1a90: 2023-07-15 16:12:52,654 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=f69e92a6bf43512e4624a8ec75ac7e43, regionState=CLOSED 2023-07-15 16:12:52,654 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed f69e92a6bf43512e4624a8ec75ac7e43 2023-07-15 16:12:52,654 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689437558293.f69e92a6bf43512e4624a8ec75ac7e43.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689437572653"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689437572653"}]},"ts":"1689437572653"} 2023-07-15 16:12:52,654 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 1ee93900529301daa05c34606f9c1a90 2023-07-15 16:12:52,655 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=1ee93900529301daa05c34606f9c1a90, regionState=CLOSED 2023-07-15 16:12:52,655 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689437558293.1ee93900529301daa05c34606f9c1a90.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689437572655"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689437572655"}]},"ts":"1689437572655"} 2023-07-15 16:12:52,659 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=101 2023-07-15 16:12:52,659 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=101, state=SUCCESS; CloseRegionProcedure 1ee93900529301daa05c34606f9c1a90, server=jenkins-hbase4.apache.org,43103,1689437454905 in 206 msec 2023-07-15 16:12:52,659 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=100 2023-07-15 16:12:52,659 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=100, state=SUCCESS; CloseRegionProcedure f69e92a6bf43512e4624a8ec75ac7e43, server=jenkins-hbase4.apache.org,45149,1689437455062 in 206 msec 2023-07-15 16:12:52,663 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=f69e92a6bf43512e4624a8ec75ac7e43, UNASSIGN in 215 msec 2023-07-15 16:12:52,663 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=101, resume processing ppid=99 2023-07-15 16:12:52,663 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=1ee93900529301daa05c34606f9c1a90, UNASSIGN in 216 msec 2023-07-15 16:12:52,664 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689437572664"}]},"ts":"1689437572664"} 2023-07-15 16:12:52,666 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-07-15 16:12:52,669 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-07-15 16:12:52,672 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 237 msec 2023-07-15 16:12:52,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-15 16:12:52,744 INFO [Listener at jenkins-hbase4.apache.org/42699] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-07-15 16:12:52,745 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-07-15 16:12:52,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-15 16:12:52,750 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-15 16:12:52,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-07-15 16:12:52,752 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-15 16:12:52,753 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43103] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-07-15 16:12:52,756 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-15 16:12:52,756 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-15 16:12:52,756 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-15 16:12:52,756 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-15 16:12:52,756 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-15 16:12:52,757 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-15 16:12:52,757 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-15 16:12:52,758 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-15 16:12:52,758 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testEmptyExportFileSystemState/1ee93900529301daa05c34606f9c1a90 2023-07-15 16:12:52,758 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testEmptyExportFileSystemState/f69e92a6bf43512e4624a8ec75ac7e43 2023-07-15 16:12:52,761 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-15 16:12:52,761 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 16:12:52,761 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-15 16:12:52,761 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 16:12:52,761 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-15 16:12:52,761 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 16:12:52,761 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-15 16:12:52,761 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 16:12:52,762 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testEmptyExportFileSystemState/1ee93900529301daa05c34606f9c1a90/cf, FileablePath, hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testEmptyExportFileSystemState/1ee93900529301daa05c34606f9c1a90/recovered.edits] 2023-07-15 16:12:52,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-15 16:12:52,762 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testEmptyExportFileSystemState/f69e92a6bf43512e4624a8ec75ac7e43/cf, FileablePath, hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testEmptyExportFileSystemState/f69e92a6bf43512e4624a8ec75ac7e43/recovered.edits] 2023-07-15 16:12:52,771 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testEmptyExportFileSystemState/f69e92a6bf43512e4624a8ec75ac7e43/cf/5585cec9d7b94256a7b62103407ea7b6 to hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/archive/data/default/testtb-testEmptyExportFileSystemState/f69e92a6bf43512e4624a8ec75ac7e43/cf/5585cec9d7b94256a7b62103407ea7b6 2023-07-15 16:12:52,774 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testEmptyExportFileSystemState/1ee93900529301daa05c34606f9c1a90/cf/6bd0bff1508845b19a168f6bb70a5266 to hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/archive/data/default/testtb-testEmptyExportFileSystemState/1ee93900529301daa05c34606f9c1a90/cf/6bd0bff1508845b19a168f6bb70a5266 2023-07-15 16:12:52,780 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testEmptyExportFileSystemState/1ee93900529301daa05c34606f9c1a90/recovered.edits/9.seqid to hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/archive/data/default/testtb-testEmptyExportFileSystemState/1ee93900529301daa05c34606f9c1a90/recovered.edits/9.seqid 2023-07-15 16:12:52,780 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testEmptyExportFileSystemState/1ee93900529301daa05c34606f9c1a90 2023-07-15 16:12:52,781 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testEmptyExportFileSystemState/f69e92a6bf43512e4624a8ec75ac7e43/recovered.edits/9.seqid to hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/archive/data/default/testtb-testEmptyExportFileSystemState/f69e92a6bf43512e4624a8ec75ac7e43/recovered.edits/9.seqid 2023-07-15 16:12:52,782 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testEmptyExportFileSystemState/f69e92a6bf43512e4624a8ec75ac7e43 2023-07-15 16:12:52,782 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-15 16:12:52,784 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-15 16:12:52,787 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-07-15 16:12:52,793 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-07-15 16:12:52,794 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-15 16:12:52,794 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-07-15 16:12:52,795 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1689437558293.f69e92a6bf43512e4624a8ec75ac7e43.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689437572795"}]},"ts":"9223372036854775807"} 2023-07-15 16:12:52,795 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1689437558293.1ee93900529301daa05c34606f9c1a90.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689437572795"}]},"ts":"9223372036854775807"} 2023-07-15 16:12:52,800 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-15 16:12:52,800 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => f69e92a6bf43512e4624a8ec75ac7e43, NAME => 'testtb-testEmptyExportFileSystemState,,1689437558293.f69e92a6bf43512e4624a8ec75ac7e43.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 1ee93900529301daa05c34606f9c1a90, NAME => 'testtb-testEmptyExportFileSystemState,1,1689437558293.1ee93900529301daa05c34606f9c1a90.', STARTKEY => '1', ENDKEY => ''}] 2023-07-15 16:12:52,800 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-07-15 16:12:52,801 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689437572801"}]},"ts":"9223372036854775807"} 2023-07-15 16:12:52,811 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-07-15 16:12:52,813 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-15 16:12:52,815 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 68 msec 2023-07-15 16:12:52,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-15 16:12:52,864 INFO [Listener at jenkins-hbase4.apache.org/42699] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-07-15 16:12:52,873 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-07-15 16:12:52,875 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:52,877 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-07-15 16:12:52,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:52,922 INFO [Listener at jenkins-hbase4.apache.org/42699] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testEmptyExportFileSystemState Thread=763 (was 759) Potentially hanging thread: hconnection-0x606da78-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1447389510_1 at /127.0.0.1:52530 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-127961896_17 at /127.0.0.1:49072 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x606da78-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1012686161) connection to jenkins-hbase4.apache.org/172.31.14.131:38159 from appattempt_1689437464006_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x606da78-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-127961896_17 at /127.0.0.1:51094 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4600 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x606da78-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-127961896_17 at /127.0.0.1:52562 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1012686161) connection to jenkins-hbase4.apache.org/172.31.14.131:33397 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1447389510_1 at /127.0.0.1:49058 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=902 (was 901) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=675 (was 648) - SystemLoadAverage LEAK? -, ProcessCount=184 (was 185), AvailableMemoryMB=1561 (was 2365) 2023-07-15 16:12:52,922 WARN [Listener at jenkins-hbase4.apache.org/42699] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-07-15 16:12:52,945 INFO [Listener at jenkins-hbase4.apache.org/42699] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=763, OpenFileDescriptor=902, MaxFileDescriptor=60000, SystemLoadAverage=675, ProcessCount=184, AvailableMemoryMB=1561 2023-07-15 16:12:52,945 WARN [Listener at jenkins-hbase4.apache.org/42699] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-07-15 16:12:52,947 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-15 16:12:52,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:52,950 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-07-15 16:12:52,950 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-07-15 16:12:52,951 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-15 16:12:52,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-15 16:12:52,953 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/2ccede4567258ca107dbe26d7a112423 2023-07-15 16:12:52,953 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/f3fc1bd8ad01f6af33207255d4c1829e 2023-07-15 16:12:52,954 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/2ccede4567258ca107dbe26d7a112423 empty. 2023-07-15 16:12:52,954 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/f3fc1bd8ad01f6af33207255d4c1829e empty. 2023-07-15 16:12:52,954 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/2ccede4567258ca107dbe26d7a112423 2023-07-15 16:12:52,954 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/f3fc1bd8ad01f6af33207255d4c1829e 2023-07-15 16:12:52,954 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-15 16:12:52,991 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-07-15 16:12:52,993 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => 2ccede4567258ca107dbe26d7a112423, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689437572946.2ccede4567258ca107dbe26d7a112423.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp 2023-07-15 16:12:52,993 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => f3fc1bd8ad01f6af33207255d4c1829e, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689437572946.f3fc1bd8ad01f6af33207255d4c1829e.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp 2023-07-15 16:12:53,022 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689437572946.2ccede4567258ca107dbe26d7a112423.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 16:12:53,022 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing 2ccede4567258ca107dbe26d7a112423, disabling compactions & flushes 2023-07-15 16:12:53,022 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689437572946.f3fc1bd8ad01f6af33207255d4c1829e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 16:12:53,022 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689437572946.2ccede4567258ca107dbe26d7a112423. 2023-07-15 16:12:53,023 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing f3fc1bd8ad01f6af33207255d4c1829e, disabling compactions & flushes 2023-07-15 16:12:53,023 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689437572946.2ccede4567258ca107dbe26d7a112423. 2023-07-15 16:12:53,023 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689437572946.f3fc1bd8ad01f6af33207255d4c1829e. 2023-07-15 16:12:53,023 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689437572946.2ccede4567258ca107dbe26d7a112423. after waiting 0 ms 2023-07-15 16:12:53,023 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689437572946.2ccede4567258ca107dbe26d7a112423. 2023-07-15 16:12:53,023 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689437572946.f3fc1bd8ad01f6af33207255d4c1829e. 2023-07-15 16:12:53,023 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689437572946.2ccede4567258ca107dbe26d7a112423. 2023-07-15 16:12:53,023 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689437572946.f3fc1bd8ad01f6af33207255d4c1829e. after waiting 0 ms 2023-07-15 16:12:53,023 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for 2ccede4567258ca107dbe26d7a112423: 2023-07-15 16:12:53,023 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689437572946.f3fc1bd8ad01f6af33207255d4c1829e. 2023-07-15 16:12:53,023 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689437572946.f3fc1bd8ad01f6af33207255d4c1829e. 2023-07-15 16:12:53,023 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for f3fc1bd8ad01f6af33207255d4c1829e: 2023-07-15 16:12:53,025 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-07-15 16:12:53,026 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689437572946.2ccede4567258ca107dbe26d7a112423.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689437573026"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689437573026"}]},"ts":"1689437573026"} 2023-07-15 16:12:53,026 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689437572946.f3fc1bd8ad01f6af33207255d4c1829e.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689437573026"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689437573026"}]},"ts":"1689437573026"} 2023-07-15 16:12:53,029 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-15 16:12:53,029 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-15 16:12:53,030 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689437573029"}]},"ts":"1689437573029"} 2023-07-15 16:12:53,031 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-07-15 16:12:53,033 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-15 16:12:53,035 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-15 16:12:53,035 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-15 16:12:53,035 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-15 16:12:53,035 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-15 16:12:53,035 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=2ccede4567258ca107dbe26d7a112423, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=f3fc1bd8ad01f6af33207255d4c1829e, ASSIGN}] 2023-07-15 16:12:53,037 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=2ccede4567258ca107dbe26d7a112423, ASSIGN 2023-07-15 16:12:53,037 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=f3fc1bd8ad01f6af33207255d4c1829e, ASSIGN 2023-07-15 16:12:53,038 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=2ccede4567258ca107dbe26d7a112423, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35773,1689437454990; forceNewPlan=false, retain=false 2023-07-15 16:12:53,038 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=f3fc1bd8ad01f6af33207255d4c1829e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43103,1689437454905; forceNewPlan=false, retain=false 2023-07-15 16:12:53,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-15 16:12:53,188 INFO [jenkins-hbase4:37255] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-15 16:12:53,192 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=2ccede4567258ca107dbe26d7a112423, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:12:53,192 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=f3fc1bd8ad01f6af33207255d4c1829e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:53,192 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689437572946.2ccede4567258ca107dbe26d7a112423.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689437573192"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689437573192"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689437573192"}]},"ts":"1689437573192"} 2023-07-15 16:12:53,192 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689437572946.f3fc1bd8ad01f6af33207255d4c1829e.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689437573192"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689437573192"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689437573192"}]},"ts":"1689437573192"} 2023-07-15 16:12:53,194 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=108, ppid=106, state=RUNNABLE; OpenRegionProcedure 2ccede4567258ca107dbe26d7a112423, server=jenkins-hbase4.apache.org,35773,1689437454990}] 2023-07-15 16:12:53,196 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure f3fc1bd8ad01f6af33207255d4c1829e, server=jenkins-hbase4.apache.org,43103,1689437454905}] 2023-07-15 16:12:53,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-15 16:12:53,353 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1689437572946.2ccede4567258ca107dbe26d7a112423. 2023-07-15 16:12:53,353 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2ccede4567258ca107dbe26d7a112423, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689437572946.2ccede4567258ca107dbe26d7a112423.', STARTKEY => '', ENDKEY => '1'} 2023-07-15 16:12:53,354 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1689437572946.2ccede4567258ca107dbe26d7a112423. service=AccessControlService 2023-07-15 16:12:53,354 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1689437572946.f3fc1bd8ad01f6af33207255d4c1829e. 2023-07-15 16:12:53,354 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f3fc1bd8ad01f6af33207255d4c1829e, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689437572946.f3fc1bd8ad01f6af33207255d4c1829e.', STARTKEY => '1', ENDKEY => ''} 2023-07-15 16:12:53,354 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 16:12:53,354 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 2ccede4567258ca107dbe26d7a112423 2023-07-15 16:12:53,354 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1689437572946.f3fc1bd8ad01f6af33207255d4c1829e. service=AccessControlService 2023-07-15 16:12:53,354 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689437572946.2ccede4567258ca107dbe26d7a112423.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 16:12:53,354 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 2ccede4567258ca107dbe26d7a112423 2023-07-15 16:12:53,354 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 2ccede4567258ca107dbe26d7a112423 2023-07-15 16:12:53,354 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 16:12:53,354 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp f3fc1bd8ad01f6af33207255d4c1829e 2023-07-15 16:12:53,354 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689437572946.f3fc1bd8ad01f6af33207255d4c1829e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 16:12:53,355 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f3fc1bd8ad01f6af33207255d4c1829e 2023-07-15 16:12:53,355 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f3fc1bd8ad01f6af33207255d4c1829e 2023-07-15 16:12:53,355 INFO [StoreOpener-2ccede4567258ca107dbe26d7a112423-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 2ccede4567258ca107dbe26d7a112423 2023-07-15 16:12:53,355 INFO [StoreOpener-f3fc1bd8ad01f6af33207255d4c1829e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region f3fc1bd8ad01f6af33207255d4c1829e 2023-07-15 16:12:53,357 DEBUG [StoreOpener-2ccede4567258ca107dbe26d7a112423-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportFileSystemStateWithSkipTmp/2ccede4567258ca107dbe26d7a112423/cf 2023-07-15 16:12:53,357 DEBUG [StoreOpener-2ccede4567258ca107dbe26d7a112423-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportFileSystemStateWithSkipTmp/2ccede4567258ca107dbe26d7a112423/cf 2023-07-15 16:12:53,357 DEBUG [StoreOpener-f3fc1bd8ad01f6af33207255d4c1829e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportFileSystemStateWithSkipTmp/f3fc1bd8ad01f6af33207255d4c1829e/cf 2023-07-15 16:12:53,357 DEBUG [StoreOpener-f3fc1bd8ad01f6af33207255d4c1829e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportFileSystemStateWithSkipTmp/f3fc1bd8ad01f6af33207255d4c1829e/cf 2023-07-15 16:12:53,357 INFO [StoreOpener-2ccede4567258ca107dbe26d7a112423-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2ccede4567258ca107dbe26d7a112423 columnFamilyName cf 2023-07-15 16:12:53,357 INFO [StoreOpener-f3fc1bd8ad01f6af33207255d4c1829e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f3fc1bd8ad01f6af33207255d4c1829e columnFamilyName cf 2023-07-15 16:12:53,358 INFO [StoreOpener-2ccede4567258ca107dbe26d7a112423-1] regionserver.HStore(310): Store=2ccede4567258ca107dbe26d7a112423/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 16:12:53,358 INFO [StoreOpener-f3fc1bd8ad01f6af33207255d4c1829e-1] regionserver.HStore(310): Store=f3fc1bd8ad01f6af33207255d4c1829e/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 16:12:53,359 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportFileSystemStateWithSkipTmp/2ccede4567258ca107dbe26d7a112423 2023-07-15 16:12:53,359 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportFileSystemStateWithSkipTmp/f3fc1bd8ad01f6af33207255d4c1829e 2023-07-15 16:12:53,359 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportFileSystemStateWithSkipTmp/f3fc1bd8ad01f6af33207255d4c1829e 2023-07-15 16:12:53,359 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportFileSystemStateWithSkipTmp/2ccede4567258ca107dbe26d7a112423 2023-07-15 16:12:53,361 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f3fc1bd8ad01f6af33207255d4c1829e 2023-07-15 16:12:53,362 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 2ccede4567258ca107dbe26d7a112423 2023-07-15 16:12:53,363 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportFileSystemStateWithSkipTmp/f3fc1bd8ad01f6af33207255d4c1829e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 16:12:53,364 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f3fc1bd8ad01f6af33207255d4c1829e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70172173, jitterRate=0.04564686119556427}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 16:12:53,364 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f3fc1bd8ad01f6af33207255d4c1829e: 2023-07-15 16:12:53,364 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportFileSystemStateWithSkipTmp/2ccede4567258ca107dbe26d7a112423/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 16:12:53,364 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 2ccede4567258ca107dbe26d7a112423; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66380578, jitterRate=-0.010852307081222534}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 16:12:53,364 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1689437572946.f3fc1bd8ad01f6af33207255d4c1829e., pid=109, masterSystemTime=1689437573350 2023-07-15 16:12:53,364 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 2ccede4567258ca107dbe26d7a112423: 2023-07-15 16:12:53,365 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1689437572946.2ccede4567258ca107dbe26d7a112423., pid=108, masterSystemTime=1689437573347 2023-07-15 16:12:53,366 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1689437572946.f3fc1bd8ad01f6af33207255d4c1829e. 2023-07-15 16:12:53,366 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1689437572946.f3fc1bd8ad01f6af33207255d4c1829e. 2023-07-15 16:12:53,367 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=f3fc1bd8ad01f6af33207255d4c1829e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:53,367 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1689437572946.2ccede4567258ca107dbe26d7a112423. 2023-07-15 16:12:53,367 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1689437572946.2ccede4567258ca107dbe26d7a112423. 2023-07-15 16:12:53,367 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689437572946.f3fc1bd8ad01f6af33207255d4c1829e.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689437573366"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689437573366"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689437573366"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689437573366"}]},"ts":"1689437573366"} 2023-07-15 16:12:53,367 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=2ccede4567258ca107dbe26d7a112423, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:12:53,367 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689437572946.2ccede4567258ca107dbe26d7a112423.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689437573367"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689437573367"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689437573367"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689437573367"}]},"ts":"1689437573367"} 2023-07-15 16:12:53,370 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=107 2023-07-15 16:12:53,370 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure f3fc1bd8ad01f6af33207255d4c1829e, server=jenkins-hbase4.apache.org,43103,1689437454905 in 172 msec 2023-07-15 16:12:53,370 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=106 2023-07-15 16:12:53,370 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=106, state=SUCCESS; OpenRegionProcedure 2ccede4567258ca107dbe26d7a112423, server=jenkins-hbase4.apache.org,35773,1689437454990 in 175 msec 2023-07-15 16:12:53,371 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=f3fc1bd8ad01f6af33207255d4c1829e, ASSIGN in 335 msec 2023-07-15 16:12:53,372 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=106, resume processing ppid=105 2023-07-15 16:12:53,372 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=2ccede4567258ca107dbe26d7a112423, ASSIGN in 335 msec 2023-07-15 16:12:53,372 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-15 16:12:53,372 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689437573372"}]},"ts":"1689437573372"} 2023-07-15 16:12:53,373 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-07-15 16:12:53,375 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-07-15 16:12:53,375 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-07-15 16:12:53,377 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43103] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-15 16:12:53,378 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 16:12:53,378 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 16:12:53,378 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 16:12:53,378 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 16:12:53,379 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-15 16:12:53,379 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-15 16:12:53,379 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-15 16:12:53,379 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-15 16:12:53,380 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 432 msec 2023-07-15 16:12:53,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-15 16:12:53,554 INFO [Listener at jenkins-hbase4.apache.org/42699] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-07-15 16:12:53,554 DEBUG [Listener at jenkins-hbase4.apache.org/42699] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemStateWithSkipTmp get assigned. Timeout = 60000ms 2023-07-15 16:12:53,555 INFO [Listener at jenkins-hbase4.apache.org/42699] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 16:12:53,558 INFO [Listener at jenkins-hbase4.apache.org/42699] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemStateWithSkipTmp assigned to meta. Checking AM states. 2023-07-15 16:12:53,558 INFO [Listener at jenkins-hbase4.apache.org/42699] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 16:12:53,558 INFO [Listener at jenkins-hbase4.apache.org/42699] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemStateWithSkipTmp assigned. 2023-07-15 16:12:53,560 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-15 16:12:53,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689437573560 (current time:1689437573560). 2023-07-15 16:12:53,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 16:12:53,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] zookeeper.ReadOnlyZKClient(139): Connect 0x2a63b628 to 127.0.0.1:58438 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 16:12:53,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3f0384f3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 16:12:53,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 16:12:53,570 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50770, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 16:12:53,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2a63b628 to 127.0.0.1:58438 2023-07-15 16:12:53,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 16:12:53,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] zookeeper.ReadOnlyZKClient(139): Connect 0x2c104602 to 127.0.0.1:58438 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 16:12:53,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1b75775e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 16:12:53,579 DEBUG [hconnection-0x38724cdf-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 16:12:53,581 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50784, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 16:12:53,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2c104602 to 127.0.0.1:58438 2023-07-15 16:12:53,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 16:12:53,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-15 16:12:53,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 16:12:53,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-15 16:12:53,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] procedure2.ProcedureExecutor(1029): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-15 16:12:53,590 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-15 16:12:53,591 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689438173591 2023-07-15 16:12:53,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-15 16:12:53,591 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:53,592 DEBUG [Listener at jenkins-hbase4.apache.org/42699] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 16:12:53,592 DEBUG [Listener at jenkins-hbase4.apache.org/42699] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 16:12:53,592 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-15 16:12:53,593 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-15 16:12:53,594 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 5 msec 2023-07-15 16:12:53,595 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-15 16:12:53,595 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689438173595 2023-07-15 16:12:53,610 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:53,610 INFO [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-15 16:12:53,610 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 16:12:53,611 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-15 16:12:53,611 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-15 16:12:53,612 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:53,612 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:53,614 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:12:53,614 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:12:53,614 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:12:53,614 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:12:53,614 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:12:53,614 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:12:53,614 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:12:53,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:12:53,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:12:53,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:12:53,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:53,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:53,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:53,615 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:12:53,615 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:53,615 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:53,615 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:53,615 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:53,615 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:53,615 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 16:12:53,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-15 16:12:53,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:53,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-15 16:12:53,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:53,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-15 16:12:53,616 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-15 16:12:53,616 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-15 16:12:53,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:53,616 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-15 16:12:53,618 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:53,618 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:53,618 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-15 16:12:53,618 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-15 16:12:53,618 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 16:12:53,618 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 16:12:53,619 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-15 16:12:53,620 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-15 16:12:53,620 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35773,1689437454990' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-15 16:12:53,618 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:53,620 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-15 16:12:53,620 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-15 16:12:53,620 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-15 16:12:53,620 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 16:12:53,620 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45149,1689437455062' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-15 16:12:53,621 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-15 16:12:53,621 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-15 16:12:53,621 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43103,1689437454905' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-15 16:12:53,625 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:53,626 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:53,626 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:53,626 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 16:12:53,627 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:53,627 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:53,627 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 16:12:53,627 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:53,627 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 16:12:53,629 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:12:53,629 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:53,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:12:53,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:12:53,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:12:53,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:12:53,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:12:53,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:53,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:12:53,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:53,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:53,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:12:53,632 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35773,1689437454990' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-15 16:12:53,633 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@32df134c[Count = 1] remaining members to acquire global barrier 2023-07-15 16:12:53,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:53,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:12:53,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:12:53,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:12:53,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:12:53,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:53,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:12:53,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:53,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:53,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:12:53,637 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43103,1689437454905' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-15 16:12:53,637 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@32df134c[Count = 0] remaining members to acquire global barrier 2023-07-15 16:12:53,637 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-15 16:12:53,637 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:53,639 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:53,639 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:53,639 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:53,639 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:53,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:53,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:53,639 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:53,639 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-15 16:12:53,639 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:53,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:53,639 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-15 16:12:53,639 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-15 16:12:53,639 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 16:12:53,640 DEBUG [rs(jenkins-hbase4.apache.org,35773,1689437454990)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689437572946.2ccede4567258ca107dbe26d7a112423. 2023-07-15 16:12:53,640 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:12:53,639 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-15 16:12:53,639 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,45149,1689437455062' in zk 2023-07-15 16:12:53,640 DEBUG [rs(jenkins-hbase4.apache.org,35773,1689437454990)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689437572946.2ccede4567258ca107dbe26d7a112423. started... 2023-07-15 16:12:53,640 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 16:12:53,642 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:53,642 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 16:12:53,644 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 16:12:53,644 DEBUG [rs(jenkins-hbase4.apache.org,35773,1689437454990)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2ccede4567258ca107dbe26d7a112423: 2023-07-15 16:12:53,644 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 16:12:53,644 DEBUG [rs(jenkins-hbase4.apache.org,35773,1689437454990)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689437572946.2ccede4567258ca107dbe26d7a112423.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:53,644 DEBUG [rs(jenkins-hbase4.apache.org,35773,1689437454990)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 16:12:53,644 DEBUG [rs(jenkins-hbase4.apache.org,35773,1689437454990)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-15 16:12:53,647 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-15 16:12:53,647 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 16:12:53,647 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-15 16:12:53,655 DEBUG [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689437572946.f3fc1bd8ad01f6af33207255d4c1829e. 2023-07-15 16:12:53,655 DEBUG [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689437572946.f3fc1bd8ad01f6af33207255d4c1829e. started... 2023-07-15 16:12:53,657 DEBUG [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f3fc1bd8ad01f6af33207255d4c1829e: 2023-07-15 16:12:53,658 DEBUG [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689437572946.f3fc1bd8ad01f6af33207255d4c1829e.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:53,658 DEBUG [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 16:12:53,658 DEBUG [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-15 16:12:53,667 DEBUG [rs(jenkins-hbase4.apache.org,35773,1689437454990)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689437572946.2ccede4567258ca107dbe26d7a112423. completed. 2023-07-15 16:12:53,667 DEBUG [rs(jenkins-hbase4.apache.org,35773,1689437454990)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689437572946.2ccede4567258ca107dbe26d7a112423. 2023-07-15 16:12:53,667 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 16:12:53,667 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 16:12:53,667 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:12:53,667 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-15 16:12:53,667 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,35773,1689437454990' in zk 2023-07-15 16:12:53,677 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:12:53,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:12:53,677 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-15 16:12:53,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:12:53,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:12:53,677 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 16:12:53,677 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-15 16:12:53,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:12:53,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:12:53,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:53,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:12:53,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:53,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:53,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:12:53,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:53,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:53,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:12:53,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,35773,1689437454990': 2023-07-15 16:12:53,682 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35773,1689437454990' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-15 16:12:53,692 DEBUG [Listener at jenkins-hbase4.apache.org/42699] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 16:12:53,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-15 16:12:53,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-15 16:12:53,693 DEBUG [Listener at jenkins-hbase4.apache.org/42699] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 16:12:53,722 DEBUG [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689437572946.f3fc1bd8ad01f6af33207255d4c1829e. completed. 2023-07-15 16:12:53,723 DEBUG [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689437572946.f3fc1bd8ad01f6af33207255d4c1829e. 2023-07-15 16:12:53,723 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 16:12:53,723 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 16:12:53,723 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:53,723 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-15 16:12:53,723 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,43103,1689437454905' in zk 2023-07-15 16:12:53,725 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:53,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:53,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:12:53,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:12:53,725 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-15 16:12:53,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:12:53,725 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 16:12:53,726 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-15 16:12:53,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:12:53,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:53,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:12:53,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:53,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:53,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:12:53,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:53,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:53,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:12:53,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:53,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,43103,1689437454905': 2023-07-15 16:12:53,733 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43103,1689437454905' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-15 16:12:53,733 INFO [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-15 16:12:53,733 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 16:12:53,733 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 16:12:53,733 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:53,733 INFO [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 16:12:53,735 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:53,735 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:12:53,735 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:53,735 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:53,736 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:53,735 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:53,736 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:12:53,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:53,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:53,736 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:53,736 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:12:53,736 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:53,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:53,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:12:53,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:12:53,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:53,736 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:12:53,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:12:53,737 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:12:53,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:12:53,737 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:12:53,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:53,737 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:12:53,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:12:53,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:53,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:12:53,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:53,738 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:53,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:53,739 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:53,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:12:53,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:53,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:12:53,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:53,741 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:53,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:53,742 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:12:53,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:12:53,742 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:53,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:53,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:53,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:12:53,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:53,749 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:53,749 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:12:53,749 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:53,749 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:12:53,749 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:53,749 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:12:53,749 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:12:53,749 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:12:53,749 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:12:53,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:12:53,749 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:12:53,749 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:53,749 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:12:53,750 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:53,750 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:12:53,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:12:53,749 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:53,750 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:53,750 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:53,750 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:12:53,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:12:53,749 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 16:12:53,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:12:53,750 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:12:53,750 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:53,750 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:53,750 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:53,750 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:12:53,753 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:12:53,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:12:53,753 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:53,754 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:12:53,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:12:53,819 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:53,894 DEBUG [Listener at jenkins-hbase4.apache.org/42699] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 16:12:53,894 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-15 16:12:53,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-15 16:12:53,895 DEBUG [Listener at jenkins-hbase4.apache.org/42699] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-15 16:12:53,948 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-15 16:12:53,948 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:53,948 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:53,948 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689437573591Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689437573749 (+158 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689437573750 (+1 ms)Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689437573770 (+20 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689437573812 (+42 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689437573948 (+136 ms) 2023-07-15 16:12:53,952 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-15 16:12:53,955 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 360 msec 2023-07-15 16:12:54,195 DEBUG [Listener at jenkins-hbase4.apache.org/42699] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 16:12:54,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-15 16:12:54,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 16:12:54,218 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35773] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1689437572946.2ccede4567258ca107dbe26d7a112423. with WAL disabled. Data may be lost in the event of a crash. 2023-07-15 16:12:54,219 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43103] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1689437572946.f3fc1bd8ad01f6af33207255d4c1829e. with WAL disabled. Data may be lost in the event of a crash. 2023-07-15 16:12:54,222 DEBUG [Listener at jenkins-hbase4.apache.org/42699] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:54,222 DEBUG [Listener at jenkins-hbase4.apache.org/42699] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689437572946.2ccede4567258ca107dbe26d7a112423. 2023-07-15 16:12:54,224 INFO [Listener at jenkins-hbase4.apache.org/42699] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 16:12:54,236 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-15 16:12:54,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689437574236 (current time:1689437574236). 2023-07-15 16:12:54,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 16:12:54,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] zookeeper.ReadOnlyZKClient(139): Connect 0x66f37db4 to 127.0.0.1:58438 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 16:12:54,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4c4dd101, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 16:12:54,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 16:12:54,251 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50790, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 16:12:54,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x66f37db4 to 127.0.0.1:58438 2023-07-15 16:12:54,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 16:12:54,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] zookeeper.ReadOnlyZKClient(139): Connect 0x1154c147 to 127.0.0.1:58438 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 16:12:54,262 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6cb71004, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 16:12:54,264 DEBUG [hconnection-0x4ed0014a-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 16:12:54,265 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50792, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 16:12:54,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1154c147 to 127.0.0.1:58438 2023-07-15 16:12:54,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 16:12:54,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-15 16:12:54,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 16:12:54,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-15 16:12:54,273 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-15 16:12:54,274 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-15 16:12:54,275 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689438174275 2023-07-15 16:12:54,275 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:54,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-15 16:12:54,276 DEBUG [Listener at jenkins-hbase4.apache.org/42699] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 16:12:54,277 DEBUG [Listener at jenkins-hbase4.apache.org/42699] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 16:12:54,277 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-15 16:12:54,277 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-15 16:12:54,278 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 5 msec 2023-07-15 16:12:54,279 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-15 16:12:54,286 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689438174285 2023-07-15 16:12:54,294 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:54,294 INFO [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-15 16:12:54,294 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 16:12:54,296 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-15 16:12:54,296 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-15 16:12:54,374 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:54,374 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:54,376 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:12:54,376 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:12:54,376 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:12:54,376 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:12:54,376 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:12:54,376 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:12:54,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:12:54,376 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:12:54,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:12:54,376 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:12:54,376 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:54,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:12:54,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:54,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:54,377 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:54,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:54,377 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 16:12:54,377 DEBUG [Listener at jenkins-hbase4.apache.org/42699] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 16:12:54,377 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:54,377 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:54,377 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:54,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-15 16:12:54,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-15 16:12:54,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-15 16:12:54,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:54,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:54,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:54,378 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-15 16:12:54,378 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-15 16:12:54,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-15 16:12:54,379 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-15 16:12:54,379 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-15 16:12:54,379 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:54,379 DEBUG [Listener at jenkins-hbase4.apache.org/42699] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 16:12:54,379 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:54,379 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-15 16:12:54,379 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 16:12:54,379 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-15 16:12:54,379 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 16:12:54,382 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:54,384 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-15 16:12:54,385 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-15 16:12:54,384 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-15 16:12:54,385 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-15 16:12:54,385 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 16:12:54,385 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-15 16:12:54,385 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45149,1689437455062' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-15 16:12:54,386 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-15 16:12:54,386 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-15 16:12:54,385 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43103,1689437454905' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-15 16:12:54,387 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35773,1689437454990' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-15 16:12:54,389 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:54,389 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:54,389 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:54,389 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 16:12:54,389 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:54,389 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:12:54,390 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:54,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:12:54,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:12:54,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:12:54,390 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:54,390 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 16:12:54,390 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:54,390 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 16:12:54,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:12:54,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:12:54,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:54,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:54,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:12:54,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:54,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:12:54,392 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35773,1689437454990' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-15 16:12:54,392 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6d72e77a[Count = 1] remaining members to acquire global barrier 2023-07-15 16:12:54,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:54,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:12:54,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:12:54,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:12:54,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:12:54,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:54,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:54,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:12:54,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:54,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:12:54,394 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43103,1689437454905' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-15 16:12:54,395 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6d72e77a[Count = 0] remaining members to acquire global barrier 2023-07-15 16:12:54,395 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-15 16:12:54,395 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:54,400 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:54,400 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:54,400 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:54,400 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:54,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:54,400 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:54,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:54,400 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:54,400 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-15 16:12:54,401 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-15 16:12:54,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:54,401 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,45149,1689437455062' in zk 2023-07-15 16:12:54,401 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-15 16:12:54,401 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-15 16:12:54,401 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 16:12:54,401 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 16:12:54,401 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:12:54,402 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 16:12:54,402 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 16:12:54,402 DEBUG [rs(jenkins-hbase4.apache.org,35773,1689437454990)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689437572946.2ccede4567258ca107dbe26d7a112423. 2023-07-15 16:12:54,402 DEBUG [rs(jenkins-hbase4.apache.org,35773,1689437454990)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689437572946.2ccede4567258ca107dbe26d7a112423. started... 2023-07-15 16:12:54,402 INFO [rs(jenkins-hbase4.apache.org,35773,1689437454990)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 2ccede4567258ca107dbe26d7a112423 1/1 column families, dataSize=400 B heapSize=1.09 KB 2023-07-15 16:12:54,402 DEBUG [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689437572946.f3fc1bd8ad01f6af33207255d4c1829e. 2023-07-15 16:12:54,402 DEBUG [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689437572946.f3fc1bd8ad01f6af33207255d4c1829e. started... 2023-07-15 16:12:54,402 INFO [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] regionserver.HRegion(2745): Flushing f3fc1bd8ad01f6af33207255d4c1829e 1/1 column families, dataSize=2.87 KB heapSize=6.44 KB 2023-07-15 16:12:54,403 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:54,403 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 16:12:54,403 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-15 16:12:54,404 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 16:12:54,404 DEBUG [member: 'jenkins-hbase4.apache.org,45149,1689437455062' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-15 16:12:54,452 INFO [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.87 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportFileSystemStateWithSkipTmp/f3fc1bd8ad01f6af33207255d4c1829e/.tmp/cf/1fea8dd11f1e49f9b45ca6d83ec0f734 2023-07-15 16:12:54,454 INFO [rs(jenkins-hbase4.apache.org,35773,1689437454990)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=400 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportFileSystemStateWithSkipTmp/2ccede4567258ca107dbe26d7a112423/.tmp/cf/5b02f07480b24bd180f01307a4e3e7c6 2023-07-15 16:12:54,460 DEBUG [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportFileSystemStateWithSkipTmp/f3fc1bd8ad01f6af33207255d4c1829e/.tmp/cf/1fea8dd11f1e49f9b45ca6d83ec0f734 as hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportFileSystemStateWithSkipTmp/f3fc1bd8ad01f6af33207255d4c1829e/cf/1fea8dd11f1e49f9b45ca6d83ec0f734 2023-07-15 16:12:54,462 DEBUG [rs(jenkins-hbase4.apache.org,35773,1689437454990)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportFileSystemStateWithSkipTmp/2ccede4567258ca107dbe26d7a112423/.tmp/cf/5b02f07480b24bd180f01307a4e3e7c6 as hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportFileSystemStateWithSkipTmp/2ccede4567258ca107dbe26d7a112423/cf/5b02f07480b24bd180f01307a4e3e7c6 2023-07-15 16:12:54,466 INFO [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportFileSystemStateWithSkipTmp/f3fc1bd8ad01f6af33207255d4c1829e/cf/1fea8dd11f1e49f9b45ca6d83ec0f734, entries=44, sequenceid=6, filesize=7.8 K 2023-07-15 16:12:54,467 INFO [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.87 KB/2936, heapSize ~6.42 KB/6576, currentSize=0 B/0 for f3fc1bd8ad01f6af33207255d4c1829e in 65ms, sequenceid=6, compaction requested=false 2023-07-15 16:12:54,467 DEBUG [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-15 16:12:54,468 DEBUG [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f3fc1bd8ad01f6af33207255d4c1829e: 2023-07-15 16:12:54,468 DEBUG [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689437572946.f3fc1bd8ad01f6af33207255d4c1829e.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:54,468 DEBUG [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 16:12:54,468 INFO [rs(jenkins-hbase4.apache.org,35773,1689437454990)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportFileSystemStateWithSkipTmp/2ccede4567258ca107dbe26d7a112423/cf/5b02f07480b24bd180f01307a4e3e7c6, entries=6, sequenceid=6, filesize=5.2 K 2023-07-15 16:12:54,468 DEBUG [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportFileSystemStateWithSkipTmp/f3fc1bd8ad01f6af33207255d4c1829e/cf/1fea8dd11f1e49f9b45ca6d83ec0f734] hfiles 2023-07-15 16:12:54,469 INFO [rs(jenkins-hbase4.apache.org,35773,1689437454990)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~400 B/400, heapSize ~1.08 KB/1104, currentSize=0 B/0 for 2ccede4567258ca107dbe26d7a112423 in 67ms, sequenceid=6, compaction requested=false 2023-07-15 16:12:54,469 DEBUG [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportFileSystemStateWithSkipTmp/f3fc1bd8ad01f6af33207255d4c1829e/cf/1fea8dd11f1e49f9b45ca6d83ec0f734 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:54,471 DEBUG [rs(jenkins-hbase4.apache.org,35773,1689437454990)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2ccede4567258ca107dbe26d7a112423: 2023-07-15 16:12:54,471 DEBUG [rs(jenkins-hbase4.apache.org,35773,1689437454990)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689437572946.2ccede4567258ca107dbe26d7a112423.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:54,471 DEBUG [rs(jenkins-hbase4.apache.org,35773,1689437454990)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 16:12:54,471 DEBUG [rs(jenkins-hbase4.apache.org,35773,1689437454990)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportFileSystemStateWithSkipTmp/2ccede4567258ca107dbe26d7a112423/cf/5b02f07480b24bd180f01307a4e3e7c6] hfiles 2023-07-15 16:12:54,471 DEBUG [rs(jenkins-hbase4.apache.org,35773,1689437454990)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportFileSystemStateWithSkipTmp/2ccede4567258ca107dbe26d7a112423/cf/5b02f07480b24bd180f01307a4e3e7c6 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:54,485 DEBUG [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689437572946.f3fc1bd8ad01f6af33207255d4c1829e. completed. 2023-07-15 16:12:54,485 DEBUG [rs(jenkins-hbase4.apache.org,43103,1689437454905)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689437572946.f3fc1bd8ad01f6af33207255d4c1829e. 2023-07-15 16:12:54,485 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 16:12:54,485 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 16:12:54,485 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:54,486 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-15 16:12:54,486 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,43103,1689437454905' in zk 2023-07-15 16:12:54,487 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:54,487 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-15 16:12:54,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:54,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:12:54,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:12:54,487 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 16:12:54,487 DEBUG [member: 'jenkins-hbase4.apache.org,43103,1689437454905' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-15 16:12:54,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:12:54,489 DEBUG [rs(jenkins-hbase4.apache.org,35773,1689437454990)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689437572946.2ccede4567258ca107dbe26d7a112423. completed. 2023-07-15 16:12:54,490 DEBUG [rs(jenkins-hbase4.apache.org,35773,1689437454990)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689437572946.2ccede4567258ca107dbe26d7a112423. 2023-07-15 16:12:54,490 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 16:12:54,490 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 16:12:54,490 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:12:54,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:12:54,490 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-15 16:12:54,490 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,35773,1689437454990' in zk 2023-07-15 16:12:54,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:54,491 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:12:54,491 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-15 16:12:54,491 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 16:12:54,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:54,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:12:54,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:54,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:12:54,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:54,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:54,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:12:54,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:54,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,43103,1689437454905': 2023-07-15 16:12:54,496 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43103,1689437454905' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-15 16:12:54,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:12:54,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:12:54,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:12:54,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:12:54,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:12:54,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:54,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:54,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:12:54,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:54,491 DEBUG [member: 'jenkins-hbase4.apache.org,35773,1689437454990' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-15 16:12:54,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:12:54,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:54,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:54,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:12:54,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:54,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,35773,1689437454990': 2023-07-15 16:12:54,501 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35773,1689437454990' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-15 16:12:54,501 INFO [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-15 16:12:54,502 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 16:12:54,502 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 16:12:54,502 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:54,502 INFO [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 16:12:54,504 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:54,504 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:54,504 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:12:54,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:54,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:12:54,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:12:54,505 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:54,504 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:54,505 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:54,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:54,504 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:54,505 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:12:54,505 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:54,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:54,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:54,505 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:12:54,505 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:12:54,505 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:54,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:12:54,506 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:12:54,506 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:12:54,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:12:54,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:12:54,506 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:12:54,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:54,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:54,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:12:54,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:54,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:54,507 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:54,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:12:54,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:54,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:54,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:12:54,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:54,509 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:54,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:12:54,509 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:12:54,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:54,510 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:54,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:54,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:12:54,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:54,514 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:54,514 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:12:54,514 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:12:54,514 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:12:54,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:12:54,514 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:54,514 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:12:54,514 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:12:54,514 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:12:54,514 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:12:54,514 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:54,514 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:54,514 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:12:54,514 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:54,514 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:12:54,514 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:12:54,514 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:54,514 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:54,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:12:54,514 DEBUG [(jenkins-hbase4.apache.org,37255,1689437453412)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 16:12:54,514 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:12:54,514 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:12:54,514 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:54,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:12:54,515 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:54,514 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:12:54,514 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:12:54,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:12:54,517 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:54,517 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:12:54,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:12:54,517 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:12:54,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:12:54,565 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:54,579 DEBUG [Listener at jenkins-hbase4.apache.org/42699] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 16:12:54,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-15 16:12:54,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-15 16:12:54,581 DEBUG [Listener at jenkins-hbase4.apache.org/42699] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-15 16:12:54,628 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-15 16:12:54,628 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:54,628 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:54,628 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689437574275Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689437574515 (+240 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1689437574516 (+1 ms)Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1689437574521 (+5 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689437574558 (+37 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689437574628 (+70 ms) 2023-07-15 16:12:54,632 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-15 16:12:54,633 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 356 msec 2023-07-15 16:12:54,881 DEBUG [Listener at jenkins-hbase4.apache.org/42699] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 16:12:54,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-15 16:12:54,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 16:12:54,882 INFO [Listener at jenkins-hbase4.apache.org/42699] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/export-test/export-1689437574882 2023-07-15 16:12:54,882 INFO [Listener at jenkins-hbase4.apache.org/42699] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:44749, tgtDir=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/export-test/export-1689437574882, rawTgtDir=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/export-test/export-1689437574882, srcFsUri=hdfs://localhost:44749, srcDir=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8 2023-07-15 16:12:54,908 DEBUG [Listener at jenkins-hbase4.apache.org/42699] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44749, inputRoot=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8 2023-07-15 16:12:54,908 DEBUG [Listener at jenkins-hbase4.apache.org/42699] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-122960542_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/export-test/export-1689437574882, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/export-test/export-1689437574882/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:54,909 INFO [Listener at jenkins-hbase4.apache.org/42699] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44749, inputRoot=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8, snapshotDir=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-07-15 16:12:54,917 INFO [Listener at jenkins-hbase4.apache.org/42699] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/export-test/export-1689437574882/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:54,953 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-15 16:12:54,954 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-15 16:12:54,954 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-15 16:12:54,955 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-15 16:12:55,994 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1587f29c-5daf-234a-1773-5088522b715e/hadoop-7413375342695655899.jar 2023-07-15 16:12:55,995 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-15 16:12:55,996 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-15 16:12:56,083 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1587f29c-5daf-234a-1773-5088522b715e/hadoop-459966284191007830.jar 2023-07-15 16:12:56,084 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-15 16:12:56,084 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-15 16:12:56,085 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-15 16:12:56,086 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-15 16:12:56,086 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-15 16:12:56,087 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-15 16:12:56,087 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-15 16:12:56,088 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-15 16:12:56,088 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-15 16:12:56,089 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-15 16:12:56,089 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-15 16:12:56,090 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-15 16:12:56,090 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-15 16:12:56,091 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-15 16:12:56,091 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-15 16:12:56,092 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-15 16:12:56,093 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 16:12:56,093 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 16:12:56,094 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 16:12:56,094 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 16:12:56,095 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 16:12:56,095 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 16:12:56,096 DEBUG [Listener at jenkins-hbase4.apache.org/42699] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 16:12:56,659 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689437464006_0006_000001 (auth:SIMPLE) 2023-07-15 16:12:56,856 WARN [Listener at jenkins-hbase4.apache.org/42699] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-15 16:12:56,858 INFO [Listener at jenkins-hbase4.apache.org/42699] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-07-15 16:12:56,860 DEBUG [Listener at jenkins-hbase4.apache.org/42699] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-15 16:12:56,952 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 16:12:56,952 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 16:12:57,355 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689437464006_0007_000001 (auth:SIMPLE) 2023-07-15 16:12:58,273 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-15 16:13:03,280 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689437464006_0007_000001 (auth:SIMPLE) 2023-07-15 16:13:05,694 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689437464006_0007_000001 (auth:SIMPLE) 2023-07-15 16:13:09,991 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689437464006_0007_000001 (auth:SIMPLE) 2023-07-15 16:13:11,127 INFO [Listener at jenkins-hbase4.apache.org/42699] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-15 16:13:11,127 INFO [Listener at jenkins-hbase4.apache.org/42699] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-15 16:13:11,161 INFO [Listener at jenkins-hbase4.apache.org/42699] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:13:11,161 INFO [Listener at jenkins-hbase4.apache.org/42699] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-15 16:13:11,162 INFO [Listener at jenkins-hbase4.apache.org/42699] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-15 16:13:11,162 DEBUG [Listener at jenkins-hbase4.apache.org/42699] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-127961896_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:13:11,163 DEBUG [Listener at jenkins-hbase4.apache.org/42699] snapshot.TestExportSnapshot(367): hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-15 16:13:11,163 DEBUG [Listener at jenkins-hbase4.apache.org/42699] snapshot.TestExportSnapshot(367): hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-15 16:13:11,163 DEBUG [Listener at jenkins-hbase4.apache.org/42699] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-127961896_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/export-test/export-1689437574882/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/export-test/export-1689437574882/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:13:11,166 DEBUG [Listener at jenkins-hbase4.apache.org/42699] snapshot.TestExportSnapshot(367): hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/export-test/export-1689437574882/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-15 16:13:11,166 DEBUG [Listener at jenkins-hbase4.apache.org/42699] snapshot.TestExportSnapshot(367): hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/export-test/export-1689437574882/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-15 16:13:11,178 INFO [Listener at jenkins-hbase4.apache.org/42699] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 16:13:11,178 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 16:13:11,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] procedure2.ProcedureExecutor(1029): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 16:13:11,183 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-15 16:13:11,184 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689437591184"}]},"ts":"1689437591184"} 2023-07-15 16:13:11,186 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-07-15 16:13:11,188 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-07-15 16:13:11,188 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=2ccede4567258ca107dbe26d7a112423, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=f3fc1bd8ad01f6af33207255d4c1829e, UNASSIGN}] 2023-07-15 16:13:11,189 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=f3fc1bd8ad01f6af33207255d4c1829e, UNASSIGN 2023-07-15 16:13:11,191 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=2ccede4567258ca107dbe26d7a112423, UNASSIGN 2023-07-15 16:13:11,192 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=f3fc1bd8ad01f6af33207255d4c1829e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:13:11,192 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=2ccede4567258ca107dbe26d7a112423, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:13:11,192 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689437572946.f3fc1bd8ad01f6af33207255d4c1829e.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689437591192"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689437591192"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689437591192"}]},"ts":"1689437591192"} 2023-07-15 16:13:11,192 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689437572946.2ccede4567258ca107dbe26d7a112423.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689437591192"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689437591192"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689437591192"}]},"ts":"1689437591192"} 2023-07-15 16:13:11,194 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE; CloseRegionProcedure f3fc1bd8ad01f6af33207255d4c1829e, server=jenkins-hbase4.apache.org,43103,1689437454905}] 2023-07-15 16:13:11,195 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=118, ppid=115, state=RUNNABLE; CloseRegionProcedure 2ccede4567258ca107dbe26d7a112423, server=jenkins-hbase4.apache.org,35773,1689437454990}] 2023-07-15 16:13:11,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-15 16:13:11,347 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close f3fc1bd8ad01f6af33207255d4c1829e 2023-07-15 16:13:11,347 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f3fc1bd8ad01f6af33207255d4c1829e, disabling compactions & flushes 2023-07-15 16:13:11,347 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689437572946.f3fc1bd8ad01f6af33207255d4c1829e. 2023-07-15 16:13:11,347 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689437572946.f3fc1bd8ad01f6af33207255d4c1829e. 2023-07-15 16:13:11,347 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689437572946.f3fc1bd8ad01f6af33207255d4c1829e. after waiting 0 ms 2023-07-15 16:13:11,347 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689437572946.f3fc1bd8ad01f6af33207255d4c1829e. 2023-07-15 16:13:11,348 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 2ccede4567258ca107dbe26d7a112423 2023-07-15 16:13:11,348 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 2ccede4567258ca107dbe26d7a112423, disabling compactions & flushes 2023-07-15 16:13:11,348 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689437572946.2ccede4567258ca107dbe26d7a112423. 2023-07-15 16:13:11,348 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689437572946.2ccede4567258ca107dbe26d7a112423. 2023-07-15 16:13:11,348 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689437572946.2ccede4567258ca107dbe26d7a112423. after waiting 0 ms 2023-07-15 16:13:11,348 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689437572946.2ccede4567258ca107dbe26d7a112423. 2023-07-15 16:13:11,379 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportFileSystemStateWithSkipTmp/2ccede4567258ca107dbe26d7a112423/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 16:13:11,381 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 16:13:11,382 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689437572946.2ccede4567258ca107dbe26d7a112423. 2023-07-15 16:13:11,382 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 2ccede4567258ca107dbe26d7a112423: 2023-07-15 16:13:11,382 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/default/testtb-testExportFileSystemStateWithSkipTmp/f3fc1bd8ad01f6af33207255d4c1829e/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 16:13:11,384 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 16:13:11,385 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689437572946.f3fc1bd8ad01f6af33207255d4c1829e. 2023-07-15 16:13:11,385 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f3fc1bd8ad01f6af33207255d4c1829e: 2023-07-15 16:13:11,386 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 2ccede4567258ca107dbe26d7a112423 2023-07-15 16:13:11,388 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=2ccede4567258ca107dbe26d7a112423, regionState=CLOSED 2023-07-15 16:13:11,388 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689437572946.2ccede4567258ca107dbe26d7a112423.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689437591388"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689437591388"}]},"ts":"1689437591388"} 2023-07-15 16:13:11,389 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed f3fc1bd8ad01f6af33207255d4c1829e 2023-07-15 16:13:11,390 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=f3fc1bd8ad01f6af33207255d4c1829e, regionState=CLOSED 2023-07-15 16:13:11,390 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689437572946.f3fc1bd8ad01f6af33207255d4c1829e.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689437591390"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689437591390"}]},"ts":"1689437591390"} 2023-07-15 16:13:11,394 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=115 2023-07-15 16:13:11,394 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=115, state=SUCCESS; CloseRegionProcedure 2ccede4567258ca107dbe26d7a112423, server=jenkins-hbase4.apache.org,35773,1689437454990 in 196 msec 2023-07-15 16:13:11,395 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=116 2023-07-15 16:13:11,395 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=116, state=SUCCESS; CloseRegionProcedure f3fc1bd8ad01f6af33207255d4c1829e, server=jenkins-hbase4.apache.org,43103,1689437454905 in 198 msec 2023-07-15 16:13:11,397 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=2ccede4567258ca107dbe26d7a112423, UNASSIGN in 206 msec 2023-07-15 16:13:11,399 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=116, resume processing ppid=114 2023-07-15 16:13:11,399 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=f3fc1bd8ad01f6af33207255d4c1829e, UNASSIGN in 207 msec 2023-07-15 16:13:11,400 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689437591399"}]},"ts":"1689437591399"} 2023-07-15 16:13:11,401 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-07-15 16:13:11,403 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-07-15 16:13:11,406 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 225 msec 2023-07-15 16:13:11,485 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-15 16:13:11,486 INFO [Listener at jenkins-hbase4.apache.org/42699] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-07-15 16:13:11,487 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 16:13:11,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] procedure2.ProcedureExecutor(1029): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 16:13:11,490 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 16:13:11,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 16:13:11,492 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 16:13:11,493 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43103] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 16:13:11,497 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 16:13:11,497 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 16:13:11,497 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 16:13:11,497 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 16:13:11,498 DEBUG [HFileArchiver-23] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/f3fc1bd8ad01f6af33207255d4c1829e 2023-07-15 16:13:11,498 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-15 16:13:11,498 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-15 16:13:11,498 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-15 16:13:11,500 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 16:13:11,500 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 16:13:11,501 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 16:13:11,501 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 16:13:11,502 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 16:13:11,502 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 16:13:11,502 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 16:13:11,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-15 16:13:11,504 DEBUG [HFileArchiver-23] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/f3fc1bd8ad01f6af33207255d4c1829e/cf, FileablePath, hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/f3fc1bd8ad01f6af33207255d4c1829e/recovered.edits] 2023-07-15 16:13:11,498 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/2ccede4567258ca107dbe26d7a112423 2023-07-15 16:13:11,502 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data null 2023-07-15 16:13:11,511 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-15 16:13:11,517 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/f3fc1bd8ad01f6af33207255d4c1829e/cf/1fea8dd11f1e49f9b45ca6d83ec0f734 to hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/f3fc1bd8ad01f6af33207255d4c1829e/cf/1fea8dd11f1e49f9b45ca6d83ec0f734 2023-07-15 16:13:11,518 DEBUG [HFileArchiver-22] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/2ccede4567258ca107dbe26d7a112423/cf, FileablePath, hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/2ccede4567258ca107dbe26d7a112423/recovered.edits] 2023-07-15 16:13:11,527 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/f3fc1bd8ad01f6af33207255d4c1829e/recovered.edits/9.seqid to hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/f3fc1bd8ad01f6af33207255d4c1829e/recovered.edits/9.seqid 2023-07-15 16:13:11,528 DEBUG [HFileArchiver-23] backup.HFileArchiver(596): Deleted hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/f3fc1bd8ad01f6af33207255d4c1829e 2023-07-15 16:13:11,528 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/2ccede4567258ca107dbe26d7a112423/cf/5b02f07480b24bd180f01307a4e3e7c6 to hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/2ccede4567258ca107dbe26d7a112423/cf/5b02f07480b24bd180f01307a4e3e7c6 2023-07-15 16:13:11,532 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/2ccede4567258ca107dbe26d7a112423/recovered.edits/9.seqid to hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/2ccede4567258ca107dbe26d7a112423/recovered.edits/9.seqid 2023-07-15 16:13:11,535 DEBUG [HFileArchiver-22] backup.HFileArchiver(596): Deleted hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/2ccede4567258ca107dbe26d7a112423 2023-07-15 16:13:11,535 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-15 16:13:11,538 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 16:13:11,541 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-07-15 16:13:11,546 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-07-15 16:13:11,547 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 16:13:11,547 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-07-15 16:13:11,548 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689437572946.2ccede4567258ca107dbe26d7a112423.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689437591548"}]},"ts":"9223372036854775807"} 2023-07-15 16:13:11,548 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689437572946.f3fc1bd8ad01f6af33207255d4c1829e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689437591548"}]},"ts":"9223372036854775807"} 2023-07-15 16:13:11,551 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-15 16:13:11,552 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 2ccede4567258ca107dbe26d7a112423, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689437572946.2ccede4567258ca107dbe26d7a112423.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => f3fc1bd8ad01f6af33207255d4c1829e, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689437572946.f3fc1bd8ad01f6af33207255d4c1829e.', STARTKEY => '1', ENDKEY => ''}] 2023-07-15 16:13:11,552 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-07-15 16:13:11,552 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689437591552"}]},"ts":"9223372036854775807"} 2023-07-15 16:13:11,554 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-07-15 16:13:11,559 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 16:13:11,564 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 72 msec 2023-07-15 16:13:11,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-15 16:13:11,605 INFO [Listener at jenkins-hbase4.apache.org/42699] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-07-15 16:13:11,615 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-15 16:13:11,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:13:11,621 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-15 16:13:11,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37255] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:13:11,664 INFO [Listener at jenkins-hbase4.apache.org/42699] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=763 (was 763), OpenFileDescriptor=896 (was 902), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=767 (was 675) - SystemLoadAverage LEAK? -, ProcessCount=187 (was 184) - ProcessCount LEAK? -, AvailableMemoryMB=1311 (was 1561) 2023-07-15 16:13:11,664 WARN [Listener at jenkins-hbase4.apache.org/42699] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-07-15 16:13:11,664 INFO [Listener at jenkins-hbase4.apache.org/42699] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-07-15 16:13:11,681 INFO [Listener at jenkins-hbase4.apache.org/42699] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-15 16:13:11,840 WARN [ContainersLauncher #0] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1689437464006_0007_01_000001 is : 143 2023-07-15 16:13:16,952 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-15 16:13:25,823 INFO [Listener at jenkins-hbase4.apache.org/42699] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-15 16:13:25,826 WARN [1455418546@qtp-454956227-1 - Acceptor0 HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:40807] http.HttpServer2$SelectChannelConnectorWithSafeStartup(546): HttpServer Acceptor: isRunning is false. Rechecking. 2023-07-15 16:13:25,827 WARN [1455418546@qtp-454956227-1 - Acceptor0 HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:40807] http.HttpServer2$SelectChannelConnectorWithSafeStartup(555): HttpServer Acceptor: isRunning is false 2023-07-15 16:13:39,942 ERROR [Thread[Thread-410,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-15 16:13:39,943 INFO [Listener at jenkins-hbase4.apache.org/42699] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-15 16:13:40,054 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-07-15 16:13:40,063 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-07-15 16:13:40,064 ERROR [Thread[Thread-420,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-15 16:13:40,080 INFO [Listener at jenkins-hbase4.apache.org/42699] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-15 16:13:40,184 ERROR [Thread[Thread-384,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-15 16:13:40,185 INFO [Listener at jenkins-hbase4.apache.org/42699] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-07-15 16:13:40,185 INFO [Listener at jenkins-hbase4.apache.org/42699] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-15 16:13:40,185 INFO [Listener at jenkins-hbase4.apache.org/42699] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-15 16:13:40,185 DEBUG [Listener at jenkins-hbase4.apache.org/42699] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3b044b2a to 127.0.0.1:58438 2023-07-15 16:13:40,185 DEBUG [Listener at jenkins-hbase4.apache.org/42699] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 16:13:40,185 DEBUG [Listener at jenkins-hbase4.apache.org/42699] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-15 16:13:40,185 DEBUG [Listener at jenkins-hbase4.apache.org/42699] util.JVMClusterUtil(257): Found active master hash=1896121326, stopped=false 2023-07-15 16:13:40,186 DEBUG [Listener at jenkins-hbase4.apache.org/42699] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 16:13:40,186 DEBUG [Listener at jenkins-hbase4.apache.org/42699] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-15 16:13:40,186 INFO [Listener at jenkins-hbase4.apache.org/42699] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,37255,1689437453412 2023-07-15 16:13:40,191 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-15 16:13:40,191 INFO [Listener at jenkins-hbase4.apache.org/42699] procedure2.ProcedureExecutor(629): Stopping 2023-07-15 16:13:40,191 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-15 16:13:40,191 DEBUG [Listener at jenkins-hbase4.apache.org/42699] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x768fd43d to 127.0.0.1:58438 2023-07-15 16:13:40,191 DEBUG [Listener at jenkins-hbase4.apache.org/42699] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 16:13:40,191 INFO [Listener at jenkins-hbase4.apache.org/42699] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,43103,1689437454905' ***** 2023-07-15 16:13:40,192 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-15 16:13:40,191 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-15 16:13:40,192 DEBUG [Listener at jenkins-hbase4.apache.org/42699] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 16:13:40,192 INFO [Listener at jenkins-hbase4.apache.org/42699] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-15 16:13:40,192 INFO [Listener at jenkins-hbase4.apache.org/42699] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,35773,1689437454990' ***** 2023-07-15 16:13:40,192 DEBUG [Listener at jenkins-hbase4.apache.org/42699] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 16:13:40,192 INFO [Listener at jenkins-hbase4.apache.org/42699] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-15 16:13:40,192 INFO [Listener at jenkins-hbase4.apache.org/42699] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,45149,1689437455062' ***** 2023-07-15 16:13:40,192 DEBUG [Listener at jenkins-hbase4.apache.org/42699] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 16:13:40,192 INFO [Listener at jenkins-hbase4.apache.org/42699] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-15 16:13:40,193 INFO [RS:1;jenkins-hbase4:35773] regionserver.HeapMemoryManager(220): Stopping 2023-07-15 16:13:40,193 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-15 16:13:40,192 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 16:13:40,193 INFO [RS:1;jenkins-hbase4:35773] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-15 16:13:40,191 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-15 16:13:40,193 INFO [RS:1;jenkins-hbase4:35773] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-15 16:13:40,193 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-15 16:13:40,193 INFO [RS:1;jenkins-hbase4:35773] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:13:40,193 DEBUG [RS:1;jenkins-hbase4:35773] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6aa55d4b to 127.0.0.1:58438 2023-07-15 16:13:40,193 DEBUG [RS:1;jenkins-hbase4:35773] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 16:13:40,193 INFO [RS:2;jenkins-hbase4:45149] regionserver.HeapMemoryManager(220): Stopping 2023-07-15 16:13:40,192 INFO [RS:0;jenkins-hbase4:43103] regionserver.HeapMemoryManager(220): Stopping 2023-07-15 16:13:40,194 INFO [RS:0;jenkins-hbase4:43103] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-15 16:13:40,194 INFO [RS:0;jenkins-hbase4:43103] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-15 16:13:40,194 INFO [RS:2;jenkins-hbase4:45149] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-15 16:13:40,194 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-15 16:13:40,194 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-15 16:13:40,194 INFO [RS:2;jenkins-hbase4:45149] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-15 16:13:40,194 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-15 16:13:40,194 INFO [RS:0;jenkins-hbase4:43103] regionserver.HRegionServer(3305): Received CLOSE for 8b5d5a65401d803b4727a0c1e162963b 2023-07-15 16:13:40,194 INFO [RS:2;jenkins-hbase4:45149] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:13:40,195 DEBUG [RS:2;jenkins-hbase4:45149] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1c3961ab to 127.0.0.1:58438 2023-07-15 16:13:40,195 DEBUG [RS:2;jenkins-hbase4:45149] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 16:13:40,203 INFO [RS:2;jenkins-hbase4:45149] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,45149,1689437455062; all regions closed. 2023-07-15 16:13:40,203 INFO [RS:0;jenkins-hbase4:43103] regionserver.HRegionServer(3305): Received CLOSE for 61753328474b6352129c56be3b30fd40 2023-07-15 16:13:40,203 INFO [RS:0;jenkins-hbase4:43103] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:13:40,203 DEBUG [RS:0;jenkins-hbase4:43103] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x11ec4c41 to 127.0.0.1:58438 2023-07-15 16:13:40,203 DEBUG [RS:0;jenkins-hbase4:43103] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 16:13:40,203 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-15 16:13:40,203 INFO [RS:1;jenkins-hbase4:35773] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,35773,1689437454990; all regions closed. 2023-07-15 16:13:40,205 INFO [RS:0;jenkins-hbase4:43103] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-15 16:13:40,205 INFO [RS:0;jenkins-hbase4:43103] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-15 16:13:40,205 INFO [RS:0;jenkins-hbase4:43103] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-15 16:13:40,206 INFO [RS:0;jenkins-hbase4:43103] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-15 16:13:40,206 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 8b5d5a65401d803b4727a0c1e162963b, disabling compactions & flushes 2023-07-15 16:13:40,206 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689437458792.8b5d5a65401d803b4727a0c1e162963b. 2023-07-15 16:13:40,206 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689437458792.8b5d5a65401d803b4727a0c1e162963b. 2023-07-15 16:13:40,206 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689437458792.8b5d5a65401d803b4727a0c1e162963b. after waiting 0 ms 2023-07-15 16:13:40,206 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689437458792.8b5d5a65401d803b4727a0c1e162963b. 2023-07-15 16:13:40,206 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 8b5d5a65401d803b4727a0c1e162963b 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-07-15 16:13:40,210 INFO [RS:0;jenkins-hbase4:43103] regionserver.HRegionServer(1474): Waiting on 3 regions to close 2023-07-15 16:13:40,211 DEBUG [RS:0;jenkins-hbase4:43103] regionserver.HRegionServer(1478): Online Regions={8b5d5a65401d803b4727a0c1e162963b=hbase:acl,,1689437458792.8b5d5a65401d803b4727a0c1e162963b., 1588230740=hbase:meta,,1.1588230740, 61753328474b6352129c56be3b30fd40=hbase:namespace,,1689437457847.61753328474b6352129c56be3b30fd40.} 2023-07-15 16:13:40,212 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-15 16:13:40,212 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-15 16:13:40,212 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-15 16:13:40,212 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-15 16:13:40,212 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-15 16:13:40,212 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-07-15 16:13:40,214 DEBUG [RS:0;jenkins-hbase4:43103] regionserver.HRegionServer(1504): Waiting on 1588230740, 61753328474b6352129c56be3b30fd40, 8b5d5a65401d803b4727a0c1e162963b 2023-07-15 16:13:40,261 DEBUG [RS:1;jenkins-hbase4:35773] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/oldWALs 2023-07-15 16:13:40,261 INFO [RS:1;jenkins-hbase4:35773] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C35773%2C1689437454990:(num 1689437457311) 2023-07-15 16:13:40,261 DEBUG [RS:1;jenkins-hbase4:35773] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 16:13:40,261 INFO [RS:1;jenkins-hbase4:35773] regionserver.LeaseManager(133): Closed leases 2023-07-15 16:13:40,263 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-15 16:13:40,264 INFO [RS:1;jenkins-hbase4:35773] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-15 16:13:40,264 INFO [RS:1;jenkins-hbase4:35773] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-15 16:13:40,264 INFO [RS:1;jenkins-hbase4:35773] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-15 16:13:40,264 INFO [RS:1;jenkins-hbase4:35773] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-15 16:13:40,264 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-15 16:13:40,264 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-15 16:13:40,267 INFO [RS:1;jenkins-hbase4:35773] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:35773 2023-07-15 16:13:40,270 DEBUG [RS:2;jenkins-hbase4:45149] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/oldWALs 2023-07-15 16:13:40,271 INFO [RS:2;jenkins-hbase4:45149] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C45149%2C1689437455062:(num 1689437457313) 2023-07-15 16:13:40,271 DEBUG [RS:2;jenkins-hbase4:45149] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 16:13:40,271 INFO [RS:2;jenkins-hbase4:45149] regionserver.LeaseManager(133): Closed leases 2023-07-15 16:13:40,279 INFO [RS:2;jenkins-hbase4:45149] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-15 16:13:40,280 INFO [RS:2;jenkins-hbase4:45149] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-15 16:13:40,280 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-15 16:13:40,280 INFO [RS:2;jenkins-hbase4:45149] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-15 16:13:40,280 INFO [RS:2;jenkins-hbase4:45149] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-15 16:13:40,282 INFO [RS:2;jenkins-hbase4:45149] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:45149 2023-07-15 16:13:40,284 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:13:40,284 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-15 16:13:40,284 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:13:40,284 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-15 16:13:40,284 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-15 16:13:40,284 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35773,1689437454990 2023-07-15 16:13:40,284 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-15 16:13:40,285 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:13:40,285 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:13:40,285 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45149,1689437455062 2023-07-15 16:13:40,285 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,35773,1689437454990] 2023-07-15 16:13:40,286 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,35773,1689437454990; numProcessing=1 2023-07-15 16:13:40,288 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-15 16:13:40,292 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/hbase/meta/1588230740/.tmp/info/a20ac4c6989a41a5ba380a094b604736 2023-07-15 16:13:40,298 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/hbase/acl/8b5d5a65401d803b4727a0c1e162963b/.tmp/l/83b19af4e22440ebaf02e5dbbb7f2a30 2023-07-15 16:13:40,315 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a20ac4c6989a41a5ba380a094b604736 2023-07-15 16:13:40,315 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 83b19af4e22440ebaf02e5dbbb7f2a30 2023-07-15 16:13:40,318 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/hbase/acl/8b5d5a65401d803b4727a0c1e162963b/.tmp/l/83b19af4e22440ebaf02e5dbbb7f2a30 as hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/hbase/acl/8b5d5a65401d803b4727a0c1e162963b/l/83b19af4e22440ebaf02e5dbbb7f2a30 2023-07-15 16:13:40,329 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 83b19af4e22440ebaf02e5dbbb7f2a30 2023-07-15 16:13:40,329 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/hbase/acl/8b5d5a65401d803b4727a0c1e162963b/l/83b19af4e22440ebaf02e5dbbb7f2a30, entries=7, sequenceid=18, filesize=5.2 K 2023-07-15 16:13:40,330 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for 8b5d5a65401d803b4727a0c1e162963b in 124ms, sequenceid=18, compaction requested=false 2023-07-15 16:13:40,338 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/hbase/acl/8b5d5a65401d803b4727a0c1e162963b/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-07-15 16:13:40,339 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 16:13:40,339 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1689437458792.8b5d5a65401d803b4727a0c1e162963b. 2023-07-15 16:13:40,340 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 8b5d5a65401d803b4727a0c1e162963b: 2023-07-15 16:13:40,340 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1689437458792.8b5d5a65401d803b4727a0c1e162963b. 2023-07-15 16:13:40,340 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 61753328474b6352129c56be3b30fd40, disabling compactions & flushes 2023-07-15 16:13:40,340 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689437457847.61753328474b6352129c56be3b30fd40. 2023-07-15 16:13:40,340 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689437457847.61753328474b6352129c56be3b30fd40. 2023-07-15 16:13:40,340 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689437457847.61753328474b6352129c56be3b30fd40. after waiting 0 ms 2023-07-15 16:13:40,340 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689437457847.61753328474b6352129c56be3b30fd40. 2023-07-15 16:13:40,340 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 61753328474b6352129c56be3b30fd40 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-15 16:13:40,340 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/hbase/meta/1588230740/.tmp/rep_barrier/bea8c9b3e7ba42b1b5d7160137651c50 2023-07-15 16:13:40,345 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bea8c9b3e7ba42b1b5d7160137651c50 2023-07-15 16:13:40,353 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/hbase/namespace/61753328474b6352129c56be3b30fd40/.tmp/info/b5dae016b5c0439f8e76942b149f0f86 2023-07-15 16:13:40,360 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/hbase/namespace/61753328474b6352129c56be3b30fd40/.tmp/info/b5dae016b5c0439f8e76942b149f0f86 as hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/hbase/namespace/61753328474b6352129c56be3b30fd40/info/b5dae016b5c0439f8e76942b149f0f86 2023-07-15 16:13:40,372 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/hbase/namespace/61753328474b6352129c56be3b30fd40/info/b5dae016b5c0439f8e76942b149f0f86, entries=2, sequenceid=6, filesize=4.8 K 2023-07-15 16:13:40,374 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 61753328474b6352129c56be3b30fd40 in 34ms, sequenceid=6, compaction requested=false 2023-07-15 16:13:40,379 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/hbase/meta/1588230740/.tmp/table/5f381c9529c643c1bf9ed128444f4095 2023-07-15 16:13:40,387 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-15 16:13:40,387 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:35773-0x10169c03b9e0002, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-15 16:13:40,387 INFO [RS:1;jenkins-hbase4:35773] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,35773,1689437454990; zookeeper connection closed. 2023-07-15 16:13:40,389 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5f381c9529c643c1bf9ed128444f4095 2023-07-15 16:13:40,390 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/hbase/meta/1588230740/.tmp/info/a20ac4c6989a41a5ba380a094b604736 as hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/hbase/meta/1588230740/info/a20ac4c6989a41a5ba380a094b604736 2023-07-15 16:13:40,391 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/hbase/namespace/61753328474b6352129c56be3b30fd40/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 16:13:40,392 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 16:13:40,396 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a20ac4c6989a41a5ba380a094b604736 2023-07-15 16:13:40,396 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/hbase/meta/1588230740/info/a20ac4c6989a41a5ba380a094b604736, entries=48, sequenceid=131, filesize=10.3 K 2023-07-15 16:13:40,398 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/hbase/meta/1588230740/.tmp/rep_barrier/bea8c9b3e7ba42b1b5d7160137651c50 as hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/hbase/meta/1588230740/rep_barrier/bea8c9b3e7ba42b1b5d7160137651c50 2023-07-15 16:13:40,405 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bea8c9b3e7ba42b1b5d7160137651c50 2023-07-15 16:13:40,405 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/hbase/meta/1588230740/rep_barrier/bea8c9b3e7ba42b1b5d7160137651c50, entries=13, sequenceid=131, filesize=6.4 K 2023-07-15 16:13:40,408 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/hbase/meta/1588230740/.tmp/table/5f381c9529c643c1bf9ed128444f4095 as hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/hbase/meta/1588230740/table/5f381c9529c643c1bf9ed128444f4095 2023-07-15 16:13:40,415 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689437457847.61753328474b6352129c56be3b30fd40. 2023-07-15 16:13:40,415 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 61753328474b6352129c56be3b30fd40: 2023-07-15 16:13:40,416 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689437457847.61753328474b6352129c56be3b30fd40. 2023-07-15 16:13:40,418 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@7082763f] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@7082763f 2023-07-15 16:13:40,418 DEBUG [RS:0;jenkins-hbase4:43103] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-15 16:13:40,451 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5f381c9529c643c1bf9ed128444f4095 2023-07-15 16:13:40,452 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/hbase/meta/1588230740/table/5f381c9529c643c1bf9ed128444f4095, entries=24, sequenceid=131, filesize=6.9 K 2023-07-15 16:13:40,457 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 245ms, sequenceid=131, compaction requested=false 2023-07-15 16:13:40,487 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-15 16:13:40,487 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:45149-0x10169c03b9e0003, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-15 16:13:40,487 INFO [RS:2;jenkins-hbase4:45149] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,45149,1689437455062; zookeeper connection closed. 2023-07-15 16:13:40,491 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@48be2938] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@48be2938 2023-07-15 16:13:40,495 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,35773,1689437454990 already deleted, retry=false 2023-07-15 16:13:40,495 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,35773,1689437454990 expired; onlineServers=2 2023-07-15 16:13:40,495 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,45149,1689437455062] 2023-07-15 16:13:40,495 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,45149,1689437455062; numProcessing=2 2023-07-15 16:13:40,498 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,45149,1689437455062 already deleted, retry=false 2023-07-15 16:13:40,498 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,45149,1689437455062 expired; onlineServers=1 2023-07-15 16:13:40,517 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-07-15 16:13:40,518 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 16:13:40,518 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-15 16:13:40,520 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-15 16:13:40,520 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-15 16:13:40,520 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-15 16:13:40,618 INFO [RS:0;jenkins-hbase4:43103] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,43103,1689437454905; all regions closed. 2023-07-15 16:13:40,628 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/WALs/jenkins-hbase4.apache.org,43103,1689437454905/jenkins-hbase4.apache.org%2C43103%2C1689437454905.meta.1689437457420.meta not finished, retry = 0 2023-07-15 16:13:40,731 DEBUG [RS:0;jenkins-hbase4:43103] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/oldWALs 2023-07-15 16:13:40,731 INFO [RS:0;jenkins-hbase4:43103] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43103%2C1689437454905.meta:.meta(num 1689437457420) 2023-07-15 16:13:40,747 DEBUG [RS:0;jenkins-hbase4:43103] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/oldWALs 2023-07-15 16:13:40,747 INFO [RS:0;jenkins-hbase4:43103] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43103%2C1689437454905:(num 1689437457311) 2023-07-15 16:13:40,747 DEBUG [RS:0;jenkins-hbase4:43103] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 16:13:40,747 INFO [RS:0;jenkins-hbase4:43103] regionserver.LeaseManager(133): Closed leases 2023-07-15 16:13:40,747 INFO [RS:0;jenkins-hbase4:43103] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-15 16:13:40,748 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-15 16:13:40,752 INFO [RS:0;jenkins-hbase4:43103] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:43103 2023-07-15 16:13:40,754 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-15 16:13:40,754 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43103,1689437454905 2023-07-15 16:13:40,755 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,43103,1689437454905] 2023-07-15 16:13:40,755 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,43103,1689437454905; numProcessing=3 2023-07-15 16:13:40,757 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,43103,1689437454905 already deleted, retry=false 2023-07-15 16:13:40,757 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,43103,1689437454905 expired; onlineServers=0 2023-07-15 16:13:40,757 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,37255,1689437453412' ***** 2023-07-15 16:13:40,757 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-15 16:13:40,758 DEBUG [M:0;jenkins-hbase4:37255] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@303989d5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-15 16:13:40,758 INFO [M:0;jenkins-hbase4:37255] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,37255,1689437453412 2023-07-15 16:13:40,758 INFO [M:0;jenkins-hbase4:37255] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,37255,1689437453412; all regions closed. 2023-07-15 16:13:40,758 DEBUG [M:0;jenkins-hbase4:37255] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 16:13:40,758 DEBUG [M:0;jenkins-hbase4:37255] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-15 16:13:40,758 DEBUG [M:0;jenkins-hbase4:37255] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-15 16:13:40,758 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689437456825] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689437456825,5,FailOnTimeoutGroup] 2023-07-15 16:13:40,758 INFO [M:0;jenkins-hbase4:37255] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-15 16:13:40,758 INFO [M:0;jenkins-hbase4:37255] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-15 16:13:40,758 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689437456825] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689437456825,5,FailOnTimeoutGroup] 2023-07-15 16:13:40,758 INFO [M:0;jenkins-hbase4:37255] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-07-15 16:13:40,758 DEBUG [M:0;jenkins-hbase4:37255] master.HMaster(1512): Stopping service threads 2023-07-15 16:13:40,759 INFO [M:0;jenkins-hbase4:37255] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-15 16:13:40,759 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-15 16:13:40,759 ERROR [M:0;jenkins-hbase4:37255] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-22,5,PEWorkerGroup] Thread[HFileArchiver-23,5,PEWorkerGroup] 2023-07-15 16:13:40,760 INFO [M:0;jenkins-hbase4:37255] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-15 16:13:40,760 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-15 16:13:40,761 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-15 16:13:40,761 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 16:13:40,761 DEBUG [M:0;jenkins-hbase4:37255] zookeeper.ZKUtil(398): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-15 16:13:40,762 WARN [M:0;jenkins-hbase4:37255] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-15 16:13:40,762 INFO [M:0;jenkins-hbase4:37255] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-15 16:13:40,762 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-15 16:13:40,762 INFO [M:0;jenkins-hbase4:37255] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-15 16:13:40,764 DEBUG [M:0;jenkins-hbase4:37255] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-15 16:13:40,764 INFO [M:0;jenkins-hbase4:37255] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-15 16:13:40,764 DEBUG [M:0;jenkins-hbase4:37255] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-15 16:13:40,764 DEBUG [M:0;jenkins-hbase4:37255] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-15 16:13:40,764 DEBUG [M:0;jenkins-hbase4:37255] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-15 16:13:40,764 INFO [M:0;jenkins-hbase4:37255] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=373.15 KB heapSize=449.35 KB 2023-07-15 16:13:40,820 INFO [M:0;jenkins-hbase4:37255] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=373.15 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/34bb02bde6d54c4a85493810f414028b 2023-07-15 16:13:40,827 INFO [M:0;jenkins-hbase4:37255] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 34bb02bde6d54c4a85493810f414028b 2023-07-15 16:13:40,828 DEBUG [M:0;jenkins-hbase4:37255] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/34bb02bde6d54c4a85493810f414028b as hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/34bb02bde6d54c4a85493810f414028b 2023-07-15 16:13:40,834 INFO [M:0;jenkins-hbase4:37255] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 34bb02bde6d54c4a85493810f414028b 2023-07-15 16:13:40,835 INFO [M:0;jenkins-hbase4:37255] regionserver.HStore(1080): Added hdfs://localhost:44749/user/jenkins/test-data/8109457b-19bb-7cee-6588-01e75e0b2cd8/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/34bb02bde6d54c4a85493810f414028b, entries=119, sequenceid=899, filesize=28.4 K 2023-07-15 16:13:40,836 INFO [M:0;jenkins-hbase4:37255] regionserver.HRegion(2948): Finished flush of dataSize ~373.15 KB/382104, heapSize ~449.34 KB/460120, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 72ms, sequenceid=899, compaction requested=false 2023-07-15 16:13:40,838 INFO [M:0;jenkins-hbase4:37255] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-15 16:13:40,838 DEBUG [M:0;jenkins-hbase4:37255] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-15 16:13:40,849 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-15 16:13:40,849 INFO [M:0;jenkins-hbase4:37255] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-15 16:13:40,850 INFO [M:0;jenkins-hbase4:37255] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:37255 2023-07-15 16:13:40,853 DEBUG [M:0;jenkins-hbase4:37255] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,37255,1689437453412 already deleted, retry=false 2023-07-15 16:13:40,856 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-15 16:13:40,856 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): regionserver:43103-0x10169c03b9e0001, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-15 16:13:40,856 INFO [RS:0;jenkins-hbase4:43103] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,43103,1689437454905; zookeeper connection closed. 2023-07-15 16:13:40,856 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@84f2566] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@84f2566 2023-07-15 16:13:40,857 INFO [Listener at jenkins-hbase4.apache.org/42699] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-15 16:13:40,956 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-15 16:13:40,956 DEBUG [Listener at localhost/39933-EventThread] zookeeper.ZKWatcher(600): master:37255-0x10169c03b9e0000, quorum=127.0.0.1:58438, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-15 16:13:40,956 INFO [M:0;jenkins-hbase4:37255] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,37255,1689437453412; zookeeper connection closed. 2023-07-15 16:13:40,958 WARN [Listener at jenkins-hbase4.apache.org/42699] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-15 16:13:40,962 INFO [Listener at jenkins-hbase4.apache.org/42699] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-15 16:13:41,070 WARN [BP-1149023919-172.31.14.131-1689437449095 heartbeating to localhost/127.0.0.1:44749] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-15 16:13:41,070 WARN [BP-1149023919-172.31.14.131-1689437449095 heartbeating to localhost/127.0.0.1:44749] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1149023919-172.31.14.131-1689437449095 (Datanode Uuid 0ad7c7c4-50ec-4659-b4ad-156e303fbe00) service to localhost/127.0.0.1:44749 2023-07-15 16:13:41,073 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1587f29c-5daf-234a-1773-5088522b715e/cluster_a516de2a-eb5f-f2ef-952b-8cb73b2d461b/dfs/data/data5/current/BP-1149023919-172.31.14.131-1689437449095] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-15 16:13:41,073 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1587f29c-5daf-234a-1773-5088522b715e/cluster_a516de2a-eb5f-f2ef-952b-8cb73b2d461b/dfs/data/data6/current/BP-1149023919-172.31.14.131-1689437449095] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-15 16:13:41,076 WARN [Listener at jenkins-hbase4.apache.org/42699] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-15 16:13:41,100 INFO [Listener at jenkins-hbase4.apache.org/42699] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-15 16:13:41,208 WARN [BP-1149023919-172.31.14.131-1689437449095 heartbeating to localhost/127.0.0.1:44749] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-15 16:13:41,208 WARN [BP-1149023919-172.31.14.131-1689437449095 heartbeating to localhost/127.0.0.1:44749] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1149023919-172.31.14.131-1689437449095 (Datanode Uuid b7deca30-a95f-4869-8e90-835069b76877) service to localhost/127.0.0.1:44749 2023-07-15 16:13:41,209 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1587f29c-5daf-234a-1773-5088522b715e/cluster_a516de2a-eb5f-f2ef-952b-8cb73b2d461b/dfs/data/data3/current/BP-1149023919-172.31.14.131-1689437449095] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-15 16:13:41,209 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1587f29c-5daf-234a-1773-5088522b715e/cluster_a516de2a-eb5f-f2ef-952b-8cb73b2d461b/dfs/data/data4/current/BP-1149023919-172.31.14.131-1689437449095] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-15 16:13:41,214 WARN [Listener at jenkins-hbase4.apache.org/42699] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-15 16:13:41,223 INFO [Listener at jenkins-hbase4.apache.org/42699] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-15 16:13:41,236 WARN [BP-1149023919-172.31.14.131-1689437449095 heartbeating to localhost/127.0.0.1:44749] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-15 16:13:41,236 WARN [BP-1149023919-172.31.14.131-1689437449095 heartbeating to localhost/127.0.0.1:44749] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1149023919-172.31.14.131-1689437449095 (Datanode Uuid 999def7e-56c6-49a0-96e0-35ca7ef0c310) service to localhost/127.0.0.1:44749 2023-07-15 16:13:41,237 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1587f29c-5daf-234a-1773-5088522b715e/cluster_a516de2a-eb5f-f2ef-952b-8cb73b2d461b/dfs/data/data1/current/BP-1149023919-172.31.14.131-1689437449095] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-15 16:13:41,237 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1587f29c-5daf-234a-1773-5088522b715e/cluster_a516de2a-eb5f-f2ef-952b-8cb73b2d461b/dfs/data/data2/current/BP-1149023919-172.31.14.131-1689437449095] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-15 16:13:41,288 INFO [Listener at jenkins-hbase4.apache.org/42699] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-15 16:13:41,417 INFO [Listener at jenkins-hbase4.apache.org/42699] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-15 16:13:41,519 INFO [Listener at jenkins-hbase4.apache.org/42699] hbase.HBaseTestingUtility(1293): Minicluster is down