2023-07-20 15:10:15,627 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-07-20 15:10:15,884 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a3c136b5-559e-274b-8286-a02c66f74c8f 2023-07-20 15:10:15,885 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-07-20 15:10:15,885 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-07-20 15:10:15,917 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-20 15:10:16,157 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-20 15:10:16,158 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a3c136b5-559e-274b-8286-a02c66f74c8f/cluster_7c972e76-1c0e-2046-c767-99afc843fe90, deleteOnExit=true 2023-07-20 15:10:16,158 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-20 15:10:16,159 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a3c136b5-559e-274b-8286-a02c66f74c8f/test.cache.data in system properties and HBase conf 2023-07-20 15:10:16,159 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a3c136b5-559e-274b-8286-a02c66f74c8f/hadoop.tmp.dir in system properties and HBase conf 2023-07-20 15:10:16,160 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a3c136b5-559e-274b-8286-a02c66f74c8f/hadoop.log.dir in system properties and HBase conf 2023-07-20 15:10:16,160 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a3c136b5-559e-274b-8286-a02c66f74c8f/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-20 15:10:16,161 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a3c136b5-559e-274b-8286-a02c66f74c8f/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-20 15:10:16,161 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-20 15:10:16,473 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-20 15:10:16,477 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a3c136b5-559e-274b-8286-a02c66f74c8f/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-20 15:10:16,478 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a3c136b5-559e-274b-8286-a02c66f74c8f/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-20 15:10:16,478 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a3c136b5-559e-274b-8286-a02c66f74c8f/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-20 15:10:16,478 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a3c136b5-559e-274b-8286-a02c66f74c8f/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-20 15:10:16,479 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a3c136b5-559e-274b-8286-a02c66f74c8f/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-20 15:10:16,479 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a3c136b5-559e-274b-8286-a02c66f74c8f/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-20 15:10:16,480 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a3c136b5-559e-274b-8286-a02c66f74c8f/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-20 15:10:16,480 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a3c136b5-559e-274b-8286-a02c66f74c8f/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-20 15:10:16,481 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a3c136b5-559e-274b-8286-a02c66f74c8f/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-20 15:10:16,481 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a3c136b5-559e-274b-8286-a02c66f74c8f/nfs.dump.dir in system properties and HBase conf 2023-07-20 15:10:16,482 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a3c136b5-559e-274b-8286-a02c66f74c8f/java.io.tmpdir in system properties and HBase conf 2023-07-20 15:10:16,482 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a3c136b5-559e-274b-8286-a02c66f74c8f/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-20 15:10:16,482 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a3c136b5-559e-274b-8286-a02c66f74c8f/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-20 15:10:16,483 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a3c136b5-559e-274b-8286-a02c66f74c8f/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-20 15:10:17,058 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-20 15:10:17,062 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-20 15:10:17,376 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-20 15:10:17,552 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-20 15:10:17,567 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-20 15:10:17,606 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-20 15:10:17,642 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a3c136b5-559e-274b-8286-a02c66f74c8f/java.io.tmpdir/Jetty_localhost_44627_hdfs____e6zyud/webapp 2023-07-20 15:10:17,794 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44627 2023-07-20 15:10:17,824 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-20 15:10:17,824 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-20 15:10:18,269 WARN [Listener at localhost/42063] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-20 15:10:18,345 WARN [Listener at localhost/42063] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-20 15:10:18,365 WARN [Listener at localhost/42063] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-20 15:10:18,372 INFO [Listener at localhost/42063] log.Slf4jLog(67): jetty-6.1.26 2023-07-20 15:10:18,378 INFO [Listener at localhost/42063] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a3c136b5-559e-274b-8286-a02c66f74c8f/java.io.tmpdir/Jetty_localhost_32777_datanode____.f4lfnl/webapp 2023-07-20 15:10:18,540 INFO [Listener at localhost/42063] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:32777 2023-07-20 15:10:19,032 WARN [Listener at localhost/45869] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-20 15:10:19,055 WARN [Listener at localhost/45869] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-20 15:10:19,059 WARN [Listener at localhost/45869] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-20 15:10:19,061 INFO [Listener at localhost/45869] log.Slf4jLog(67): jetty-6.1.26 2023-07-20 15:10:19,069 INFO [Listener at localhost/45869] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a3c136b5-559e-274b-8286-a02c66f74c8f/java.io.tmpdir/Jetty_localhost_42011_datanode____.gyklqf/webapp 2023-07-20 15:10:19,231 INFO [Listener at localhost/45869] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42011 2023-07-20 15:10:19,283 WARN [Listener at localhost/38445] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-20 15:10:19,363 WARN [Listener at localhost/38445] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-20 15:10:19,366 WARN [Listener at localhost/38445] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-20 15:10:19,368 INFO [Listener at localhost/38445] log.Slf4jLog(67): jetty-6.1.26 2023-07-20 15:10:19,377 INFO [Listener at localhost/38445] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a3c136b5-559e-274b-8286-a02c66f74c8f/java.io.tmpdir/Jetty_localhost_40023_datanode____.i50qas/webapp 2023-07-20 15:10:19,529 INFO [Listener at localhost/38445] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40023 2023-07-20 15:10:19,567 WARN [Listener at localhost/33785] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-20 15:10:19,685 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x7c6df03c184b0afb: Processing first storage report for DS-f90f7652-eea2-49c8-8ca0-9d5a83f3b3a5 from datanode f3b1399c-2b99-4424-9046-34dfc9697777 2023-07-20 15:10:19,686 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x7c6df03c184b0afb: from storage DS-f90f7652-eea2-49c8-8ca0-9d5a83f3b3a5 node DatanodeRegistration(127.0.0.1:34785, datanodeUuid=f3b1399c-2b99-4424-9046-34dfc9697777, infoPort=35461, infoSecurePort=0, ipcPort=45869, storageInfo=lv=-57;cid=testClusterID;nsid=309923475;c=1689865817140), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-20 15:10:19,687 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xb5e12b1d7a7a1d03: Processing first storage report for DS-776e8212-646d-4cd8-8777-0bc9f2539288 from datanode f813a2d3-8503-43f5-ac0f-6ea6d6af1556 2023-07-20 15:10:19,687 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xb5e12b1d7a7a1d03: from storage DS-776e8212-646d-4cd8-8777-0bc9f2539288 node DatanodeRegistration(127.0.0.1:38877, datanodeUuid=f813a2d3-8503-43f5-ac0f-6ea6d6af1556, infoPort=33037, infoSecurePort=0, ipcPort=38445, storageInfo=lv=-57;cid=testClusterID;nsid=309923475;c=1689865817140), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-20 15:10:19,687 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x7c6df03c184b0afb: Processing first storage report for DS-00f7873b-1fb9-4330-a74a-f01c6fd65b54 from datanode f3b1399c-2b99-4424-9046-34dfc9697777 2023-07-20 15:10:19,687 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x7c6df03c184b0afb: from storage DS-00f7873b-1fb9-4330-a74a-f01c6fd65b54 node DatanodeRegistration(127.0.0.1:34785, datanodeUuid=f3b1399c-2b99-4424-9046-34dfc9697777, infoPort=35461, infoSecurePort=0, ipcPort=45869, storageInfo=lv=-57;cid=testClusterID;nsid=309923475;c=1689865817140), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-20 15:10:19,687 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xb5e12b1d7a7a1d03: Processing first storage report for DS-dafd2925-7fb3-4552-bc8c-6c055c0f7e48 from datanode f813a2d3-8503-43f5-ac0f-6ea6d6af1556 2023-07-20 15:10:19,687 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xb5e12b1d7a7a1d03: from storage DS-dafd2925-7fb3-4552-bc8c-6c055c0f7e48 node DatanodeRegistration(127.0.0.1:38877, datanodeUuid=f813a2d3-8503-43f5-ac0f-6ea6d6af1556, infoPort=33037, infoSecurePort=0, ipcPort=38445, storageInfo=lv=-57;cid=testClusterID;nsid=309923475;c=1689865817140), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-20 15:10:19,744 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x5fd72a194aa8ef1d: Processing first storage report for DS-668e0520-a976-4c95-8928-bcd828a125c6 from datanode dae96c8b-cb40-4abf-a0f6-f97c5601ee90 2023-07-20 15:10:19,744 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x5fd72a194aa8ef1d: from storage DS-668e0520-a976-4c95-8928-bcd828a125c6 node DatanodeRegistration(127.0.0.1:32925, datanodeUuid=dae96c8b-cb40-4abf-a0f6-f97c5601ee90, infoPort=43543, infoSecurePort=0, ipcPort=33785, storageInfo=lv=-57;cid=testClusterID;nsid=309923475;c=1689865817140), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-20 15:10:19,745 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x5fd72a194aa8ef1d: Processing first storage report for DS-eebdfc1c-4e26-47ff-952f-e15a26216a05 from datanode dae96c8b-cb40-4abf-a0f6-f97c5601ee90 2023-07-20 15:10:19,745 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x5fd72a194aa8ef1d: from storage DS-eebdfc1c-4e26-47ff-952f-e15a26216a05 node DatanodeRegistration(127.0.0.1:32925, datanodeUuid=dae96c8b-cb40-4abf-a0f6-f97c5601ee90, infoPort=43543, infoSecurePort=0, ipcPort=33785, storageInfo=lv=-57;cid=testClusterID;nsid=309923475;c=1689865817140), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-20 15:10:20,019 DEBUG [Listener at localhost/33785] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a3c136b5-559e-274b-8286-a02c66f74c8f 2023-07-20 15:10:20,111 INFO [Listener at localhost/33785] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a3c136b5-559e-274b-8286-a02c66f74c8f/cluster_7c972e76-1c0e-2046-c767-99afc843fe90/zookeeper_0, clientPort=64446, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a3c136b5-559e-274b-8286-a02c66f74c8f/cluster_7c972e76-1c0e-2046-c767-99afc843fe90/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a3c136b5-559e-274b-8286-a02c66f74c8f/cluster_7c972e76-1c0e-2046-c767-99afc843fe90/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-20 15:10:20,137 INFO [Listener at localhost/33785] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=64446 2023-07-20 15:10:20,164 INFO [Listener at localhost/33785] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-20 15:10:20,167 INFO [Listener at localhost/33785] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-20 15:10:20,921 INFO [Listener at localhost/33785] util.FSUtils(471): Created version file at hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b with version=8 2023-07-20 15:10:20,921 INFO [Listener at localhost/33785] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/hbase-staging 2023-07-20 15:10:21,274 INFO [Listener at localhost/33785] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-20 15:10:21,833 INFO [Listener at localhost/33785] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-07-20 15:10:21,875 INFO [Listener at localhost/33785] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-20 15:10:21,876 INFO [Listener at localhost/33785] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-20 15:10:21,876 INFO [Listener at localhost/33785] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-20 15:10:21,876 INFO [Listener at localhost/33785] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-20 15:10:21,876 INFO [Listener at localhost/33785] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-20 15:10:22,077 INFO [Listener at localhost/33785] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-20 15:10:22,174 DEBUG [Listener at localhost/33785] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-20 15:10:22,310 INFO [Listener at localhost/33785] ipc.NettyRpcServer(120): Bind to /172.31.14.131:38949 2023-07-20 15:10:22,330 INFO [Listener at localhost/33785] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-20 15:10:22,333 INFO [Listener at localhost/33785] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-20 15:10:22,366 INFO [Listener at localhost/33785] zookeeper.RecoverableZooKeeper(93): Process identifier=master:38949 connecting to ZooKeeper ensemble=127.0.0.1:64446 2023-07-20 15:10:22,419 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:389490x0, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-20 15:10:22,424 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:38949-0x10183489abc0000 connected 2023-07-20 15:10:22,464 DEBUG [Listener at localhost/33785] zookeeper.ZKUtil(164): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-20 15:10:22,465 DEBUG [Listener at localhost/33785] zookeeper.ZKUtil(164): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-20 15:10:22,479 DEBUG [Listener at localhost/33785] zookeeper.ZKUtil(164): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-20 15:10:22,488 DEBUG [Listener at localhost/33785] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38949 2023-07-20 15:10:22,488 DEBUG [Listener at localhost/33785] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38949 2023-07-20 15:10:22,489 DEBUG [Listener at localhost/33785] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38949 2023-07-20 15:10:22,490 DEBUG [Listener at localhost/33785] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38949 2023-07-20 15:10:22,491 DEBUG [Listener at localhost/33785] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38949 2023-07-20 15:10:22,497 INFO [Listener at localhost/33785] master.HMaster(444): hbase.rootdir=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b, hbase.cluster.distributed=false 2023-07-20 15:10:22,569 INFO [Listener at localhost/33785] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-20 15:10:22,569 INFO [Listener at localhost/33785] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-20 15:10:22,569 INFO [Listener at localhost/33785] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-20 15:10:22,570 INFO [Listener at localhost/33785] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-20 15:10:22,570 INFO [Listener at localhost/33785] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-20 15:10:22,570 INFO [Listener at localhost/33785] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-20 15:10:22,577 INFO [Listener at localhost/33785] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-20 15:10:22,581 INFO [Listener at localhost/33785] ipc.NettyRpcServer(120): Bind to /172.31.14.131:37315 2023-07-20 15:10:22,585 INFO [Listener at localhost/33785] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-20 15:10:22,592 INFO [Listener at localhost/33785] mob.MobFileCache(124): MobFileCache disabled 2023-07-20 15:10:22,593 INFO [Listener at localhost/33785] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-20 15:10:22,596 INFO [Listener at localhost/33785] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-20 15:10:22,599 INFO [Listener at localhost/33785] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:37315 connecting to ZooKeeper ensemble=127.0.0.1:64446 2023-07-20 15:10:22,605 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:373150x0, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-20 15:10:22,607 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:37315-0x10183489abc0001 connected 2023-07-20 15:10:22,607 DEBUG [Listener at localhost/33785] zookeeper.ZKUtil(164): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-20 15:10:22,608 DEBUG [Listener at localhost/33785] zookeeper.ZKUtil(164): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-20 15:10:22,609 DEBUG [Listener at localhost/33785] zookeeper.ZKUtil(164): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-20 15:10:22,610 DEBUG [Listener at localhost/33785] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37315 2023-07-20 15:10:22,610 DEBUG [Listener at localhost/33785] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37315 2023-07-20 15:10:22,614 DEBUG [Listener at localhost/33785] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37315 2023-07-20 15:10:22,616 DEBUG [Listener at localhost/33785] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37315 2023-07-20 15:10:22,617 DEBUG [Listener at localhost/33785] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37315 2023-07-20 15:10:22,637 INFO [Listener at localhost/33785] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-20 15:10:22,637 INFO [Listener at localhost/33785] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-20 15:10:22,637 INFO [Listener at localhost/33785] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-20 15:10:22,638 INFO [Listener at localhost/33785] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-20 15:10:22,638 INFO [Listener at localhost/33785] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-20 15:10:22,639 INFO [Listener at localhost/33785] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-20 15:10:22,639 INFO [Listener at localhost/33785] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-20 15:10:22,643 INFO [Listener at localhost/33785] ipc.NettyRpcServer(120): Bind to /172.31.14.131:46155 2023-07-20 15:10:22,643 INFO [Listener at localhost/33785] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-20 15:10:22,644 INFO [Listener at localhost/33785] mob.MobFileCache(124): MobFileCache disabled 2023-07-20 15:10:22,645 INFO [Listener at localhost/33785] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-20 15:10:22,649 INFO [Listener at localhost/33785] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-20 15:10:22,651 INFO [Listener at localhost/33785] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:46155 connecting to ZooKeeper ensemble=127.0.0.1:64446 2023-07-20 15:10:22,662 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:461550x0, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-20 15:10:22,663 DEBUG [Listener at localhost/33785] zookeeper.ZKUtil(164): regionserver:461550x0, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-20 15:10:22,664 DEBUG [Listener at localhost/33785] zookeeper.ZKUtil(164): regionserver:461550x0, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-20 15:10:22,665 DEBUG [Listener at localhost/33785] zookeeper.ZKUtil(164): regionserver:461550x0, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-20 15:10:22,668 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:46155-0x10183489abc0002 connected 2023-07-20 15:10:22,669 DEBUG [Listener at localhost/33785] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46155 2023-07-20 15:10:22,669 DEBUG [Listener at localhost/33785] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46155 2023-07-20 15:10:22,671 DEBUG [Listener at localhost/33785] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46155 2023-07-20 15:10:22,671 DEBUG [Listener at localhost/33785] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46155 2023-07-20 15:10:22,671 DEBUG [Listener at localhost/33785] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46155 2023-07-20 15:10:22,689 INFO [Listener at localhost/33785] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-20 15:10:22,689 INFO [Listener at localhost/33785] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-20 15:10:22,689 INFO [Listener at localhost/33785] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-20 15:10:22,689 INFO [Listener at localhost/33785] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-20 15:10:22,689 INFO [Listener at localhost/33785] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-20 15:10:22,689 INFO [Listener at localhost/33785] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-20 15:10:22,690 INFO [Listener at localhost/33785] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-20 15:10:22,692 INFO [Listener at localhost/33785] ipc.NettyRpcServer(120): Bind to /172.31.14.131:41343 2023-07-20 15:10:22,692 INFO [Listener at localhost/33785] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-20 15:10:22,695 INFO [Listener at localhost/33785] mob.MobFileCache(124): MobFileCache disabled 2023-07-20 15:10:22,696 INFO [Listener at localhost/33785] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-20 15:10:22,698 INFO [Listener at localhost/33785] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-20 15:10:22,699 INFO [Listener at localhost/33785] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:41343 connecting to ZooKeeper ensemble=127.0.0.1:64446 2023-07-20 15:10:22,703 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:413430x0, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-20 15:10:22,704 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:41343-0x10183489abc0003 connected 2023-07-20 15:10:22,705 DEBUG [Listener at localhost/33785] zookeeper.ZKUtil(164): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-20 15:10:22,706 DEBUG [Listener at localhost/33785] zookeeper.ZKUtil(164): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-20 15:10:22,706 DEBUG [Listener at localhost/33785] zookeeper.ZKUtil(164): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-20 15:10:22,711 DEBUG [Listener at localhost/33785] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41343 2023-07-20 15:10:22,712 DEBUG [Listener at localhost/33785] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41343 2023-07-20 15:10:22,712 DEBUG [Listener at localhost/33785] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41343 2023-07-20 15:10:22,714 DEBUG [Listener at localhost/33785] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41343 2023-07-20 15:10:22,714 DEBUG [Listener at localhost/33785] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41343 2023-07-20 15:10:22,719 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,38949,1689865821097 2023-07-20 15:10:22,729 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-20 15:10:22,730 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,38949,1689865821097 2023-07-20 15:10:22,751 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-20 15:10:22,751 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-20 15:10:22,751 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-20 15:10:22,751 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-20 15:10:22,751 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-20 15:10:22,752 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-20 15:10:22,754 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,38949,1689865821097 from backup master directory 2023-07-20 15:10:22,755 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-20 15:10:22,758 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,38949,1689865821097 2023-07-20 15:10:22,758 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-20 15:10:22,759 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-20 15:10:22,759 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,38949,1689865821097 2023-07-20 15:10:22,763 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-20 15:10:22,765 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-20 15:10:22,902 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/hbase.id with ID: a75d9bbd-0e03-4ed9-8e74-5d77070b9df8 2023-07-20 15:10:22,953 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-20 15:10:22,974 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-20 15:10:23,039 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x0afc70eb to 127.0.0.1:64446 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 15:10:23,082 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@71474652, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 15:10:23,111 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-20 15:10:23,113 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-20 15:10:23,138 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-20 15:10:23,138 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-20 15:10:23,140 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-20 15:10:23,145 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-20 15:10:23,146 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-20 15:10:23,188 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/MasterData/data/master/store-tmp 2023-07-20 15:10:23,242 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 15:10:23,242 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-20 15:10:23,242 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-20 15:10:23,242 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-20 15:10:23,242 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-20 15:10:23,242 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-20 15:10:23,243 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-20 15:10:23,243 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-20 15:10:23,244 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/MasterData/WALs/jenkins-hbase4.apache.org,38949,1689865821097 2023-07-20 15:10:23,272 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38949%2C1689865821097, suffix=, logDir=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/MasterData/WALs/jenkins-hbase4.apache.org,38949,1689865821097, archiveDir=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/MasterData/oldWALs, maxLogs=10 2023-07-20 15:10:23,356 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38877,DS-776e8212-646d-4cd8-8777-0bc9f2539288,DISK] 2023-07-20 15:10:23,359 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:32925,DS-668e0520-a976-4c95-8928-bcd828a125c6,DISK] 2023-07-20 15:10:23,359 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34785,DS-f90f7652-eea2-49c8-8ca0-9d5a83f3b3a5,DISK] 2023-07-20 15:10:23,371 DEBUG [RS-EventLoopGroup-5-3] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-20 15:10:23,461 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/MasterData/WALs/jenkins-hbase4.apache.org,38949,1689865821097/jenkins-hbase4.apache.org%2C38949%2C1689865821097.1689865823282 2023-07-20 15:10:23,462 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:32925,DS-668e0520-a976-4c95-8928-bcd828a125c6,DISK], DatanodeInfoWithStorage[127.0.0.1:38877,DS-776e8212-646d-4cd8-8777-0bc9f2539288,DISK], DatanodeInfoWithStorage[127.0.0.1:34785,DS-f90f7652-eea2-49c8-8ca0-9d5a83f3b3a5,DISK]] 2023-07-20 15:10:23,463 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-20 15:10:23,463 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 15:10:23,467 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-20 15:10:23,469 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-20 15:10:23,564 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-20 15:10:23,573 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-20 15:10:23,613 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-20 15:10:23,635 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 15:10:23,643 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-20 15:10:23,645 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-20 15:10:23,665 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-20 15:10:23,669 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 15:10:23,671 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60058385, jitterRate=-0.10506032407283783}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 15:10:23,671 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-20 15:10:23,672 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-20 15:10:23,696 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-20 15:10:23,696 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-20 15:10:23,699 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-20 15:10:23,702 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-20 15:10:23,749 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 47 msec 2023-07-20 15:10:23,749 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-20 15:10:23,781 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-20 15:10:23,788 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-20 15:10:23,821 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-20 15:10:23,828 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-20 15:10:23,830 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-20 15:10:23,837 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-20 15:10:23,841 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-20 15:10:23,844 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-20 15:10:23,858 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-20 15:10:23,859 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-20 15:10:23,876 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-20 15:10:23,883 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-20 15:10:23,883 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-20 15:10:23,883 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-20 15:10:23,883 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-20 15:10:23,883 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-20 15:10:23,887 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,38949,1689865821097, sessionid=0x10183489abc0000, setting cluster-up flag (Was=false) 2023-07-20 15:10:23,910 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-20 15:10:23,917 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-20 15:10:23,919 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,38949,1689865821097 2023-07-20 15:10:23,926 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-20 15:10:23,935 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-20 15:10:23,937 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,38949,1689865821097 2023-07-20 15:10:23,940 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.hbase-snapshot/.tmp 2023-07-20 15:10:24,020 INFO [RS:1;jenkins-hbase4:46155] regionserver.HRegionServer(951): ClusterId : a75d9bbd-0e03-4ed9-8e74-5d77070b9df8 2023-07-20 15:10:24,023 INFO [RS:2;jenkins-hbase4:41343] regionserver.HRegionServer(951): ClusterId : a75d9bbd-0e03-4ed9-8e74-5d77070b9df8 2023-07-20 15:10:24,021 INFO [RS:0;jenkins-hbase4:37315] regionserver.HRegionServer(951): ClusterId : a75d9bbd-0e03-4ed9-8e74-5d77070b9df8 2023-07-20 15:10:24,026 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-20 15:10:24,031 DEBUG [RS:2;jenkins-hbase4:41343] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-20 15:10:24,031 DEBUG [RS:1;jenkins-hbase4:46155] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-20 15:10:24,031 DEBUG [RS:0;jenkins-hbase4:37315] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-20 15:10:24,032 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 15:10:24,033 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-20 15:10:24,045 DEBUG [RS:0;jenkins-hbase4:37315] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-20 15:10:24,045 DEBUG [RS:1;jenkins-hbase4:46155] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-20 15:10:24,045 DEBUG [RS:2;jenkins-hbase4:41343] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-20 15:10:24,046 DEBUG [RS:1;jenkins-hbase4:46155] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-20 15:10:24,045 DEBUG [RS:0;jenkins-hbase4:37315] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-20 15:10:24,046 DEBUG [RS:2;jenkins-hbase4:41343] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-20 15:10:24,056 DEBUG [RS:1;jenkins-hbase4:46155] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-20 15:10:24,056 DEBUG [RS:0;jenkins-hbase4:37315] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-20 15:10:24,056 DEBUG [RS:2;jenkins-hbase4:41343] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-20 15:10:24,059 DEBUG [RS:0;jenkins-hbase4:37315] zookeeper.ReadOnlyZKClient(139): Connect 0x5c807ec0 to 127.0.0.1:64446 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 15:10:24,059 DEBUG [RS:2;jenkins-hbase4:41343] zookeeper.ReadOnlyZKClient(139): Connect 0x3ce2dd49 to 127.0.0.1:64446 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 15:10:24,058 DEBUG [RS:1;jenkins-hbase4:46155] zookeeper.ReadOnlyZKClient(139): Connect 0x4ff95368 to 127.0.0.1:64446 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 15:10:24,095 DEBUG [RS:2;jenkins-hbase4:41343] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@67946d8e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 15:10:24,099 DEBUG [RS:2;jenkins-hbase4:41343] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@dbd3a2f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-20 15:10:24,103 DEBUG [RS:1;jenkins-hbase4:46155] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@79dbedd0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 15:10:24,103 DEBUG [RS:1;jenkins-hbase4:46155] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4bc9a99f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-20 15:10:24,104 DEBUG [RS:0;jenkins-hbase4:37315] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@369539b5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 15:10:24,104 DEBUG [RS:0;jenkins-hbase4:37315] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@67776632, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-20 15:10:24,128 DEBUG [RS:2;jenkins-hbase4:41343] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:41343 2023-07-20 15:10:24,131 DEBUG [RS:1;jenkins-hbase4:46155] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:46155 2023-07-20 15:10:24,135 INFO [RS:1;jenkins-hbase4:46155] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-20 15:10:24,136 INFO [RS:1;jenkins-hbase4:46155] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-20 15:10:24,136 DEBUG [RS:1;jenkins-hbase4:46155] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-20 15:10:24,135 INFO [RS:2;jenkins-hbase4:41343] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-20 15:10:24,137 INFO [RS:1;jenkins-hbase4:46155] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 15:10:24,137 DEBUG [RS:1;jenkins-hbase4:46155] regionserver.HRegionServer(1022): About to register with Master. 2023-07-20 15:10:24,137 INFO [RS:2;jenkins-hbase4:41343] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-20 15:10:24,138 DEBUG [RS:2;jenkins-hbase4:41343] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-20 15:10:24,138 INFO [RS:2;jenkins-hbase4:41343] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 15:10:24,138 DEBUG [RS:2;jenkins-hbase4:41343] regionserver.HRegionServer(1022): About to register with Master. 2023-07-20 15:10:24,142 INFO [RS:1;jenkins-hbase4:46155] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,38949,1689865821097 with isa=jenkins-hbase4.apache.org/172.31.14.131:46155, startcode=1689865822636 2023-07-20 15:10:24,142 INFO [RS:2;jenkins-hbase4:41343] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,38949,1689865821097 with isa=jenkins-hbase4.apache.org/172.31.14.131:41343, startcode=1689865822688 2023-07-20 15:10:24,171 DEBUG [RS:0;jenkins-hbase4:37315] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:37315 2023-07-20 15:10:24,171 INFO [RS:0;jenkins-hbase4:37315] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-20 15:10:24,171 INFO [RS:0;jenkins-hbase4:37315] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-20 15:10:24,171 DEBUG [RS:0;jenkins-hbase4:37315] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-20 15:10:24,171 INFO [RS:0;jenkins-hbase4:37315] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 15:10:24,171 DEBUG [RS:0;jenkins-hbase4:37315] regionserver.HRegionServer(1022): About to register with Master. 2023-07-20 15:10:24,173 INFO [RS:0;jenkins-hbase4:37315] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,38949,1689865821097 with isa=jenkins-hbase4.apache.org/172.31.14.131:37315, startcode=1689865822568 2023-07-20 15:10:24,175 DEBUG [RS:0;jenkins-hbase4:37315] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-20 15:10:24,176 DEBUG [RS:2;jenkins-hbase4:41343] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-20 15:10:24,177 DEBUG [RS:1;jenkins-hbase4:46155] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-20 15:10:24,180 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-20 15:10:24,193 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-20 15:10:24,193 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-20 15:10:24,193 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-20 15:10:24,194 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-20 15:10:24,194 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-07-20 15:10:24,194 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 15:10:24,194 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-20 15:10:24,194 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 15:10:24,218 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689865854218 2023-07-20 15:10:24,221 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-20 15:10:24,241 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-20 15:10:24,261 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-20 15:10:24,262 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-20 15:10:24,262 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-20 15:10:24,262 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-20 15:10:24,267 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-20 15:10:24,267 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-20 15:10:24,268 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-20 15:10:24,268 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-20 15:10:24,279 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46795, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-20 15:10:24,279 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39557, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-20 15:10:24,283 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54667, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-20 15:10:24,293 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-20 15:10:24,295 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38949] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-20 15:10:24,295 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-20 15:10:24,296 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-20 15:10:24,309 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38949] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-20 15:10:24,309 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38949] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-20 15:10:24,317 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-20 15:10:24,317 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-20 15:10:24,322 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689865824319,5,FailOnTimeoutGroup] 2023-07-20 15:10:24,334 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689865824331,5,FailOnTimeoutGroup] 2023-07-20 15:10:24,335 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-20 15:10:24,335 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-20 15:10:24,338 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-20 15:10:24,338 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-20 15:10:24,350 DEBUG [RS:0;jenkins-hbase4:37315] regionserver.HRegionServer(2830): Master is not running yet 2023-07-20 15:10:24,350 DEBUG [RS:1;jenkins-hbase4:46155] regionserver.HRegionServer(2830): Master is not running yet 2023-07-20 15:10:24,350 WARN [RS:1;jenkins-hbase4:46155] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-20 15:10:24,350 WARN [RS:0;jenkins-hbase4:37315] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-20 15:10:24,354 DEBUG [RS:2;jenkins-hbase4:41343] regionserver.HRegionServer(2830): Master is not running yet 2023-07-20 15:10:24,354 WARN [RS:2;jenkins-hbase4:41343] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-20 15:10:24,396 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-20 15:10:24,397 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-20 15:10:24,397 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b 2023-07-20 15:10:24,451 INFO [RS:0;jenkins-hbase4:37315] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,38949,1689865821097 with isa=jenkins-hbase4.apache.org/172.31.14.131:37315, startcode=1689865822568 2023-07-20 15:10:24,453 INFO [RS:1;jenkins-hbase4:46155] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,38949,1689865821097 with isa=jenkins-hbase4.apache.org/172.31.14.131:46155, startcode=1689865822636 2023-07-20 15:10:24,454 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 15:10:24,459 INFO [RS:2;jenkins-hbase4:41343] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,38949,1689865821097 with isa=jenkins-hbase4.apache.org/172.31.14.131:41343, startcode=1689865822688 2023-07-20 15:10:24,471 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38949] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:10:24,480 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38949] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:10:24,481 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38949] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:10:24,482 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-20 15:10:24,485 DEBUG [RS:1;jenkins-hbase4:46155] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b 2023-07-20 15:10:24,485 DEBUG [RS:2;jenkins-hbase4:41343] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b 2023-07-20 15:10:24,485 DEBUG [RS:0;jenkins-hbase4:37315] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b 2023-07-20 15:10:24,485 DEBUG [RS:2;jenkins-hbase4:41343] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:42063 2023-07-20 15:10:24,485 DEBUG [RS:1;jenkins-hbase4:46155] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:42063 2023-07-20 15:10:24,486 DEBUG [RS:2;jenkins-hbase4:41343] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-20 15:10:24,486 DEBUG [RS:0;jenkins-hbase4:37315] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:42063 2023-07-20 15:10:24,486 DEBUG [RS:0;jenkins-hbase4:37315] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-20 15:10:24,486 DEBUG [RS:1;jenkins-hbase4:46155] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-20 15:10:24,493 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/hbase/meta/1588230740/info 2023-07-20 15:10:24,494 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-20 15:10:24,496 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-20 15:10:24,497 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 15:10:24,497 DEBUG [RS:1;jenkins-hbase4:46155] zookeeper.ZKUtil(162): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:10:24,497 DEBUG [RS:2;jenkins-hbase4:41343] zookeeper.ZKUtil(162): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:10:24,497 DEBUG [RS:0;jenkins-hbase4:37315] zookeeper.ZKUtil(162): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:10:24,499 WARN [RS:2;jenkins-hbase4:41343] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-20 15:10:24,500 WARN [RS:0;jenkins-hbase4:37315] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-20 15:10:24,500 INFO [RS:2;jenkins-hbase4:41343] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-20 15:10:24,499 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-20 15:10:24,500 DEBUG [RS:2;jenkins-hbase4:41343] regionserver.HRegionServer(1948): logDir=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/WALs/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:10:24,499 WARN [RS:1;jenkins-hbase4:46155] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-20 15:10:24,501 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,41343,1689865822688] 2023-07-20 15:10:24,501 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,46155,1689865822636] 2023-07-20 15:10:24,500 INFO [RS:1;jenkins-hbase4:46155] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-20 15:10:24,502 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,37315,1689865822568] 2023-07-20 15:10:24,502 DEBUG [RS:1;jenkins-hbase4:46155] regionserver.HRegionServer(1948): logDir=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/WALs/jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:10:24,500 INFO [RS:0;jenkins-hbase4:37315] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-20 15:10:24,502 DEBUG [RS:0;jenkins-hbase4:37315] regionserver.HRegionServer(1948): logDir=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/WALs/jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:10:24,510 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/hbase/meta/1588230740/rep_barrier 2023-07-20 15:10:24,511 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-20 15:10:24,513 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 15:10:24,513 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-20 15:10:24,515 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/hbase/meta/1588230740/table 2023-07-20 15:10:24,516 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-20 15:10:24,521 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 15:10:24,521 DEBUG [RS:2;jenkins-hbase4:41343] zookeeper.ZKUtil(162): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:10:24,521 DEBUG [RS:0;jenkins-hbase4:37315] zookeeper.ZKUtil(162): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:10:24,523 DEBUG [RS:0;jenkins-hbase4:37315] zookeeper.ZKUtil(162): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:10:24,523 DEBUG [RS:2;jenkins-hbase4:41343] zookeeper.ZKUtil(162): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:10:24,523 DEBUG [RS:1;jenkins-hbase4:46155] zookeeper.ZKUtil(162): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:10:24,524 DEBUG [RS:0;jenkins-hbase4:37315] zookeeper.ZKUtil(162): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:10:24,524 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/hbase/meta/1588230740 2023-07-20 15:10:24,524 DEBUG [RS:2;jenkins-hbase4:41343] zookeeper.ZKUtil(162): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:10:24,524 DEBUG [RS:1;jenkins-hbase4:46155] zookeeper.ZKUtil(162): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:10:24,525 DEBUG [RS:1;jenkins-hbase4:46155] zookeeper.ZKUtil(162): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:10:24,525 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/hbase/meta/1588230740 2023-07-20 15:10:24,530 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-20 15:10:24,542 DEBUG [RS:1;jenkins-hbase4:46155] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-20 15:10:24,543 DEBUG [RS:2;jenkins-hbase4:41343] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-20 15:10:24,542 DEBUG [RS:0;jenkins-hbase4:37315] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-20 15:10:24,547 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-20 15:10:24,556 INFO [RS:0;jenkins-hbase4:37315] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-20 15:10:24,556 INFO [RS:2;jenkins-hbase4:41343] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-20 15:10:24,557 INFO [RS:1;jenkins-hbase4:46155] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-20 15:10:24,558 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 15:10:24,559 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69948695, jitterRate=0.042316779494285583}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-20 15:10:24,559 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-20 15:10:24,559 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-20 15:10:24,559 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-20 15:10:24,559 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-20 15:10:24,560 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-20 15:10:24,560 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-20 15:10:24,561 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-20 15:10:24,561 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-20 15:10:24,568 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-20 15:10:24,568 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-20 15:10:24,582 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-20 15:10:24,585 INFO [RS:0;jenkins-hbase4:37315] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-20 15:10:24,587 INFO [RS:2;jenkins-hbase4:41343] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-20 15:10:24,591 INFO [RS:1;jenkins-hbase4:46155] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-20 15:10:24,598 INFO [RS:0;jenkins-hbase4:37315] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-20 15:10:24,598 INFO [RS:0;jenkins-hbase4:37315] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-20 15:10:24,607 INFO [RS:0;jenkins-hbase4:37315] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-20 15:10:24,609 INFO [RS:1;jenkins-hbase4:46155] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-20 15:10:24,610 INFO [RS:1;jenkins-hbase4:46155] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-20 15:10:24,615 INFO [RS:2;jenkins-hbase4:41343] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-20 15:10:24,615 INFO [RS:2;jenkins-hbase4:41343] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-20 15:10:24,615 INFO [RS:1;jenkins-hbase4:46155] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-20 15:10:24,615 INFO [RS:2;jenkins-hbase4:41343] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-20 15:10:24,620 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-20 15:10:24,627 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-20 15:10:24,629 INFO [RS:1;jenkins-hbase4:46155] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-20 15:10:24,629 DEBUG [RS:1;jenkins-hbase4:46155] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 15:10:24,629 DEBUG [RS:1;jenkins-hbase4:46155] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 15:10:24,629 DEBUG [RS:1;jenkins-hbase4:46155] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 15:10:24,629 DEBUG [RS:1;jenkins-hbase4:46155] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 15:10:24,629 DEBUG [RS:1;jenkins-hbase4:46155] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 15:10:24,630 DEBUG [RS:1;jenkins-hbase4:46155] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-20 15:10:24,630 DEBUG [RS:1;jenkins-hbase4:46155] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 15:10:24,630 DEBUG [RS:1;jenkins-hbase4:46155] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 15:10:24,630 DEBUG [RS:1;jenkins-hbase4:46155] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 15:10:24,630 DEBUG [RS:1;jenkins-hbase4:46155] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 15:10:24,632 INFO [RS:0;jenkins-hbase4:37315] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-20 15:10:24,633 INFO [RS:2;jenkins-hbase4:41343] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-20 15:10:24,633 DEBUG [RS:2;jenkins-hbase4:41343] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 15:10:24,633 DEBUG [RS:0;jenkins-hbase4:37315] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 15:10:24,635 DEBUG [RS:2;jenkins-hbase4:41343] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 15:10:24,635 DEBUG [RS:0;jenkins-hbase4:37315] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 15:10:24,635 DEBUG [RS:2;jenkins-hbase4:41343] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 15:10:24,634 INFO [RS:1;jenkins-hbase4:46155] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-20 15:10:24,635 DEBUG [RS:2;jenkins-hbase4:41343] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 15:10:24,635 INFO [RS:1;jenkins-hbase4:46155] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-20 15:10:24,635 DEBUG [RS:2;jenkins-hbase4:41343] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 15:10:24,635 INFO [RS:1;jenkins-hbase4:46155] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-20 15:10:24,635 DEBUG [RS:2;jenkins-hbase4:41343] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-20 15:10:24,635 DEBUG [RS:0;jenkins-hbase4:37315] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 15:10:24,635 DEBUG [RS:2;jenkins-hbase4:41343] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 15:10:24,636 DEBUG [RS:0;jenkins-hbase4:37315] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 15:10:24,636 DEBUG [RS:2;jenkins-hbase4:41343] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 15:10:24,636 DEBUG [RS:0;jenkins-hbase4:37315] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 15:10:24,636 DEBUG [RS:2;jenkins-hbase4:41343] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 15:10:24,636 DEBUG [RS:0;jenkins-hbase4:37315] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-20 15:10:24,636 DEBUG [RS:2;jenkins-hbase4:41343] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 15:10:24,636 DEBUG [RS:0;jenkins-hbase4:37315] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 15:10:24,636 DEBUG [RS:0;jenkins-hbase4:37315] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 15:10:24,637 DEBUG [RS:0;jenkins-hbase4:37315] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 15:10:24,637 DEBUG [RS:0;jenkins-hbase4:37315] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 15:10:24,658 INFO [RS:0;jenkins-hbase4:37315] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-20 15:10:24,658 INFO [RS:1;jenkins-hbase4:46155] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-20 15:10:24,659 INFO [RS:0;jenkins-hbase4:37315] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-20 15:10:24,659 INFO [RS:0;jenkins-hbase4:37315] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-20 15:10:24,662 INFO [RS:1;jenkins-hbase4:46155] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46155,1689865822636-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-20 15:10:24,666 INFO [RS:2;jenkins-hbase4:41343] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-20 15:10:24,667 INFO [RS:2;jenkins-hbase4:41343] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-20 15:10:24,667 INFO [RS:2;jenkins-hbase4:41343] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-20 15:10:24,679 INFO [RS:0;jenkins-hbase4:37315] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-20 15:10:24,683 INFO [RS:0;jenkins-hbase4:37315] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37315,1689865822568-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-20 15:10:24,699 INFO [RS:2;jenkins-hbase4:41343] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-20 15:10:24,699 INFO [RS:2;jenkins-hbase4:41343] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41343,1689865822688-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-20 15:10:24,706 INFO [RS:1;jenkins-hbase4:46155] regionserver.Replication(203): jenkins-hbase4.apache.org,46155,1689865822636 started 2023-07-20 15:10:24,707 INFO [RS:1;jenkins-hbase4:46155] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,46155,1689865822636, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:46155, sessionid=0x10183489abc0002 2023-07-20 15:10:24,708 INFO [RS:0;jenkins-hbase4:37315] regionserver.Replication(203): jenkins-hbase4.apache.org,37315,1689865822568 started 2023-07-20 15:10:24,708 DEBUG [RS:1;jenkins-hbase4:46155] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-20 15:10:24,708 INFO [RS:0;jenkins-hbase4:37315] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,37315,1689865822568, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:37315, sessionid=0x10183489abc0001 2023-07-20 15:10:24,708 DEBUG [RS:1;jenkins-hbase4:46155] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:10:24,708 DEBUG [RS:0;jenkins-hbase4:37315] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-20 15:10:24,708 DEBUG [RS:1;jenkins-hbase4:46155] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46155,1689865822636' 2023-07-20 15:10:24,708 DEBUG [RS:0;jenkins-hbase4:37315] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:10:24,709 DEBUG [RS:1;jenkins-hbase4:46155] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-20 15:10:24,709 DEBUG [RS:0;jenkins-hbase4:37315] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37315,1689865822568' 2023-07-20 15:10:24,710 DEBUG [RS:0;jenkins-hbase4:37315] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-20 15:10:24,710 DEBUG [RS:0;jenkins-hbase4:37315] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-20 15:10:24,710 DEBUG [RS:1;jenkins-hbase4:46155] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-20 15:10:24,712 DEBUG [RS:0;jenkins-hbase4:37315] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-20 15:10:24,712 DEBUG [RS:0;jenkins-hbase4:37315] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-20 15:10:24,712 DEBUG [RS:1;jenkins-hbase4:46155] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-20 15:10:24,712 DEBUG [RS:0;jenkins-hbase4:37315] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:10:24,712 DEBUG [RS:1;jenkins-hbase4:46155] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-20 15:10:24,712 DEBUG [RS:0;jenkins-hbase4:37315] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37315,1689865822568' 2023-07-20 15:10:24,713 DEBUG [RS:0;jenkins-hbase4:37315] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:10:24,712 DEBUG [RS:1;jenkins-hbase4:46155] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:10:24,714 DEBUG [RS:1;jenkins-hbase4:46155] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46155,1689865822636' 2023-07-20 15:10:24,714 DEBUG [RS:1;jenkins-hbase4:46155] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:10:24,714 DEBUG [RS:0;jenkins-hbase4:37315] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:10:24,715 DEBUG [RS:0;jenkins-hbase4:37315] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-20 15:10:24,715 INFO [RS:0;jenkins-hbase4:37315] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-20 15:10:24,715 INFO [RS:0;jenkins-hbase4:37315] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-20 15:10:24,715 DEBUG [RS:1;jenkins-hbase4:46155] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:10:24,717 DEBUG [RS:1;jenkins-hbase4:46155] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-20 15:10:24,717 INFO [RS:1;jenkins-hbase4:46155] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-20 15:10:24,717 INFO [RS:1;jenkins-hbase4:46155] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-20 15:10:24,726 INFO [RS:2;jenkins-hbase4:41343] regionserver.Replication(203): jenkins-hbase4.apache.org,41343,1689865822688 started 2023-07-20 15:10:24,726 INFO [RS:2;jenkins-hbase4:41343] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,41343,1689865822688, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:41343, sessionid=0x10183489abc0003 2023-07-20 15:10:24,726 DEBUG [RS:2;jenkins-hbase4:41343] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-20 15:10:24,726 DEBUG [RS:2;jenkins-hbase4:41343] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:10:24,726 DEBUG [RS:2;jenkins-hbase4:41343] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41343,1689865822688' 2023-07-20 15:10:24,726 DEBUG [RS:2;jenkins-hbase4:41343] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-20 15:10:24,727 DEBUG [RS:2;jenkins-hbase4:41343] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-20 15:10:24,728 DEBUG [RS:2;jenkins-hbase4:41343] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-20 15:10:24,728 DEBUG [RS:2;jenkins-hbase4:41343] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-20 15:10:24,728 DEBUG [RS:2;jenkins-hbase4:41343] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:10:24,728 DEBUG [RS:2;jenkins-hbase4:41343] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41343,1689865822688' 2023-07-20 15:10:24,728 DEBUG [RS:2;jenkins-hbase4:41343] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:10:24,729 DEBUG [RS:2;jenkins-hbase4:41343] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:10:24,729 DEBUG [RS:2;jenkins-hbase4:41343] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-20 15:10:24,729 INFO [RS:2;jenkins-hbase4:41343] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-20 15:10:24,729 INFO [RS:2;jenkins-hbase4:41343] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-20 15:10:24,780 DEBUG [jenkins-hbase4:38949] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-20 15:10:24,786 DEBUG [jenkins-hbase4:38949] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-20 15:10:24,793 DEBUG [jenkins-hbase4:38949] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-20 15:10:24,793 DEBUG [jenkins-hbase4:38949] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-20 15:10:24,793 DEBUG [jenkins-hbase4:38949] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-20 15:10:24,793 DEBUG [jenkins-hbase4:38949] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-20 15:10:24,796 INFO [PEWorker-2] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,37315,1689865822568, state=OPENING 2023-07-20 15:10:24,806 DEBUG [PEWorker-2] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-20 15:10:24,808 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-20 15:10:24,809 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-20 15:10:24,814 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,37315,1689865822568}] 2023-07-20 15:10:24,833 INFO [RS:0;jenkins-hbase4:37315] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37315%2C1689865822568, suffix=, logDir=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/WALs/jenkins-hbase4.apache.org,37315,1689865822568, archiveDir=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/oldWALs, maxLogs=32 2023-07-20 15:10:24,833 INFO [RS:1;jenkins-hbase4:46155] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46155%2C1689865822636, suffix=, logDir=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/WALs/jenkins-hbase4.apache.org,46155,1689865822636, archiveDir=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/oldWALs, maxLogs=32 2023-07-20 15:10:24,849 INFO [RS:2;jenkins-hbase4:41343] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41343%2C1689865822688, suffix=, logDir=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/WALs/jenkins-hbase4.apache.org,41343,1689865822688, archiveDir=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/oldWALs, maxLogs=32 2023-07-20 15:10:24,900 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38877,DS-776e8212-646d-4cd8-8777-0bc9f2539288,DISK] 2023-07-20 15:10:24,901 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38877,DS-776e8212-646d-4cd8-8777-0bc9f2539288,DISK] 2023-07-20 15:10:24,903 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:32925,DS-668e0520-a976-4c95-8928-bcd828a125c6,DISK] 2023-07-20 15:10:24,903 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34785,DS-f90f7652-eea2-49c8-8ca0-9d5a83f3b3a5,DISK] 2023-07-20 15:10:24,904 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34785,DS-f90f7652-eea2-49c8-8ca0-9d5a83f3b3a5,DISK] 2023-07-20 15:10:24,904 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:32925,DS-668e0520-a976-4c95-8928-bcd828a125c6,DISK] 2023-07-20 15:10:24,941 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:32925,DS-668e0520-a976-4c95-8928-bcd828a125c6,DISK] 2023-07-20 15:10:24,942 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38877,DS-776e8212-646d-4cd8-8777-0bc9f2539288,DISK] 2023-07-20 15:10:24,944 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34785,DS-f90f7652-eea2-49c8-8ca0-9d5a83f3b3a5,DISK] 2023-07-20 15:10:24,980 INFO [RS:2;jenkins-hbase4:41343] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/WALs/jenkins-hbase4.apache.org,41343,1689865822688/jenkins-hbase4.apache.org%2C41343%2C1689865822688.1689865824851 2023-07-20 15:10:24,980 INFO [RS:1;jenkins-hbase4:46155] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/WALs/jenkins-hbase4.apache.org,46155,1689865822636/jenkins-hbase4.apache.org%2C46155%2C1689865822636.1689865824849 2023-07-20 15:10:24,981 DEBUG [RS:2;jenkins-hbase4:41343] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38877,DS-776e8212-646d-4cd8-8777-0bc9f2539288,DISK], DatanodeInfoWithStorage[127.0.0.1:34785,DS-f90f7652-eea2-49c8-8ca0-9d5a83f3b3a5,DISK], DatanodeInfoWithStorage[127.0.0.1:32925,DS-668e0520-a976-4c95-8928-bcd828a125c6,DISK]] 2023-07-20 15:10:24,986 DEBUG [RS:1;jenkins-hbase4:46155] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:32925,DS-668e0520-a976-4c95-8928-bcd828a125c6,DISK], DatanodeInfoWithStorage[127.0.0.1:34785,DS-f90f7652-eea2-49c8-8ca0-9d5a83f3b3a5,DISK], DatanodeInfoWithStorage[127.0.0.1:38877,DS-776e8212-646d-4cd8-8777-0bc9f2539288,DISK]] 2023-07-20 15:10:24,989 INFO [RS:0;jenkins-hbase4:37315] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/WALs/jenkins-hbase4.apache.org,37315,1689865822568/jenkins-hbase4.apache.org%2C37315%2C1689865822568.1689865824849 2023-07-20 15:10:24,990 DEBUG [RS:0;jenkins-hbase4:37315] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34785,DS-f90f7652-eea2-49c8-8ca0-9d5a83f3b3a5,DISK], DatanodeInfoWithStorage[127.0.0.1:38877,DS-776e8212-646d-4cd8-8777-0bc9f2539288,DISK], DatanodeInfoWithStorage[127.0.0.1:32925,DS-668e0520-a976-4c95-8928-bcd828a125c6,DISK]] 2023-07-20 15:10:25,024 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:10:25,027 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-20 15:10:25,030 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43740, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-20 15:10:25,047 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-20 15:10:25,048 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-20 15:10:25,052 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37315%2C1689865822568.meta, suffix=.meta, logDir=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/WALs/jenkins-hbase4.apache.org,37315,1689865822568, archiveDir=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/oldWALs, maxLogs=32 2023-07-20 15:10:25,078 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38877,DS-776e8212-646d-4cd8-8777-0bc9f2539288,DISK] 2023-07-20 15:10:25,080 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34785,DS-f90f7652-eea2-49c8-8ca0-9d5a83f3b3a5,DISK] 2023-07-20 15:10:25,087 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:32925,DS-668e0520-a976-4c95-8928-bcd828a125c6,DISK] 2023-07-20 15:10:25,103 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/WALs/jenkins-hbase4.apache.org,37315,1689865822568/jenkins-hbase4.apache.org%2C37315%2C1689865822568.meta.1689865825053.meta 2023-07-20 15:10:25,110 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38877,DS-776e8212-646d-4cd8-8777-0bc9f2539288,DISK], DatanodeInfoWithStorage[127.0.0.1:34785,DS-f90f7652-eea2-49c8-8ca0-9d5a83f3b3a5,DISK], DatanodeInfoWithStorage[127.0.0.1:32925,DS-668e0520-a976-4c95-8928-bcd828a125c6,DISK]] 2023-07-20 15:10:25,111 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-20 15:10:25,113 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-20 15:10:25,115 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 15:10:25,116 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-20 15:10:25,118 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-20 15:10:25,120 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-20 15:10:25,135 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-20 15:10:25,135 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 15:10:25,135 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-20 15:10:25,135 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-20 15:10:25,138 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-20 15:10:25,141 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/hbase/meta/1588230740/info 2023-07-20 15:10:25,141 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/hbase/meta/1588230740/info 2023-07-20 15:10:25,141 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-20 15:10:25,143 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 15:10:25,145 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-20 15:10:25,147 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/hbase/meta/1588230740/rep_barrier 2023-07-20 15:10:25,147 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/hbase/meta/1588230740/rep_barrier 2023-07-20 15:10:25,147 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-20 15:10:25,148 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 15:10:25,148 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-20 15:10:25,150 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/hbase/meta/1588230740/table 2023-07-20 15:10:25,150 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/hbase/meta/1588230740/table 2023-07-20 15:10:25,150 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-20 15:10:25,151 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 15:10:25,153 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/hbase/meta/1588230740 2023-07-20 15:10:25,157 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/hbase/meta/1588230740 2023-07-20 15:10:25,161 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-20 15:10:25,164 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-20 15:10:25,166 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62461665, jitterRate=-0.06924866139888763}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-20 15:10:25,170 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-20 15:10:25,186 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689865825016 2023-07-20 15:10:25,217 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-20 15:10:25,218 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-20 15:10:25,219 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,37315,1689865822568, state=OPEN 2023-07-20 15:10:25,224 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-20 15:10:25,224 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-20 15:10:25,239 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-20 15:10:25,239 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,37315,1689865822568 in 410 msec 2023-07-20 15:10:25,249 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-20 15:10:25,250 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 660 msec 2023-07-20 15:10:25,256 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.2130 sec 2023-07-20 15:10:25,256 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689865825256, completionTime=-1 2023-07-20 15:10:25,256 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-20 15:10:25,257 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-20 15:10:25,362 DEBUG [hconnection-0x3c085ba2-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 15:10:25,367 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43752, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 15:10:25,394 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-20 15:10:25,394 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689865885394 2023-07-20 15:10:25,394 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689865945394 2023-07-20 15:10:25,394 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 137 msec 2023-07-20 15:10:25,430 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38949,1689865821097-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-20 15:10:25,431 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38949,1689865821097-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-20 15:10:25,431 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38949,1689865821097-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-20 15:10:25,434 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:38949, period=300000, unit=MILLISECONDS is enabled. 2023-07-20 15:10:25,434 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-20 15:10:25,451 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-20 15:10:25,468 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-20 15:10:25,470 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-20 15:10:25,483 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-20 15:10:25,487 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-20 15:10:25,490 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-20 15:10:25,544 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/hbase/namespace/798864104ad8a4db6af136e8938eb43e 2023-07-20 15:10:25,547 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/hbase/namespace/798864104ad8a4db6af136e8938eb43e empty. 2023-07-20 15:10:25,550 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/hbase/namespace/798864104ad8a4db6af136e8938eb43e 2023-07-20 15:10:25,550 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-20 15:10:25,610 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-20 15:10:25,612 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 798864104ad8a4db6af136e8938eb43e, NAME => 'hbase:namespace,,1689865825469.798864104ad8a4db6af136e8938eb43e.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp 2023-07-20 15:10:25,645 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689865825469.798864104ad8a4db6af136e8938eb43e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 15:10:25,645 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 798864104ad8a4db6af136e8938eb43e, disabling compactions & flushes 2023-07-20 15:10:25,645 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689865825469.798864104ad8a4db6af136e8938eb43e. 2023-07-20 15:10:25,645 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689865825469.798864104ad8a4db6af136e8938eb43e. 2023-07-20 15:10:25,645 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689865825469.798864104ad8a4db6af136e8938eb43e. after waiting 0 ms 2023-07-20 15:10:25,645 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689865825469.798864104ad8a4db6af136e8938eb43e. 2023-07-20 15:10:25,645 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689865825469.798864104ad8a4db6af136e8938eb43e. 2023-07-20 15:10:25,645 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 798864104ad8a4db6af136e8938eb43e: 2023-07-20 15:10:25,651 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-20 15:10:25,675 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689865825469.798864104ad8a4db6af136e8938eb43e.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689865825656"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689865825656"}]},"ts":"1689865825656"} 2023-07-20 15:10:25,718 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-20 15:10:25,723 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-20 15:10:25,728 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689865825723"}]},"ts":"1689865825723"} 2023-07-20 15:10:25,734 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-20 15:10:25,738 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-20 15:10:25,740 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-20 15:10:25,740 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-20 15:10:25,740 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-20 15:10:25,740 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-20 15:10:25,743 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=798864104ad8a4db6af136e8938eb43e, ASSIGN}] 2023-07-20 15:10:25,746 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=798864104ad8a4db6af136e8938eb43e, ASSIGN 2023-07-20 15:10:25,748 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=798864104ad8a4db6af136e8938eb43e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41343,1689865822688; forceNewPlan=false, retain=false 2023-07-20 15:10:25,901 INFO [jenkins-hbase4:38949] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-20 15:10:25,902 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=798864104ad8a4db6af136e8938eb43e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:10:25,903 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689865825469.798864104ad8a4db6af136e8938eb43e.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689865825902"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689865825902"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689865825902"}]},"ts":"1689865825902"} 2023-07-20 15:10:25,907 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 798864104ad8a4db6af136e8938eb43e, server=jenkins-hbase4.apache.org,41343,1689865822688}] 2023-07-20 15:10:26,062 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:10:26,063 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-20 15:10:26,066 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42658, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-20 15:10:26,075 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689865825469.798864104ad8a4db6af136e8938eb43e. 2023-07-20 15:10:26,075 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 798864104ad8a4db6af136e8938eb43e, NAME => 'hbase:namespace,,1689865825469.798864104ad8a4db6af136e8938eb43e.', STARTKEY => '', ENDKEY => ''} 2023-07-20 15:10:26,076 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1689865825469.798864104ad8a4db6af136e8938eb43e. service=AccessControlService 2023-07-20 15:10:26,077 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 15:10:26,077 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 798864104ad8a4db6af136e8938eb43e 2023-07-20 15:10:26,077 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689865825469.798864104ad8a4db6af136e8938eb43e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 15:10:26,077 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 798864104ad8a4db6af136e8938eb43e 2023-07-20 15:10:26,078 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 798864104ad8a4db6af136e8938eb43e 2023-07-20 15:10:26,082 INFO [StoreOpener-798864104ad8a4db6af136e8938eb43e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 798864104ad8a4db6af136e8938eb43e 2023-07-20 15:10:26,084 DEBUG [StoreOpener-798864104ad8a4db6af136e8938eb43e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/hbase/namespace/798864104ad8a4db6af136e8938eb43e/info 2023-07-20 15:10:26,084 DEBUG [StoreOpener-798864104ad8a4db6af136e8938eb43e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/hbase/namespace/798864104ad8a4db6af136e8938eb43e/info 2023-07-20 15:10:26,085 INFO [StoreOpener-798864104ad8a4db6af136e8938eb43e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 798864104ad8a4db6af136e8938eb43e columnFamilyName info 2023-07-20 15:10:26,087 INFO [StoreOpener-798864104ad8a4db6af136e8938eb43e-1] regionserver.HStore(310): Store=798864104ad8a4db6af136e8938eb43e/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 15:10:26,092 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/hbase/namespace/798864104ad8a4db6af136e8938eb43e 2023-07-20 15:10:26,093 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/hbase/namespace/798864104ad8a4db6af136e8938eb43e 2023-07-20 15:10:26,100 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 798864104ad8a4db6af136e8938eb43e 2023-07-20 15:10:26,108 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/hbase/namespace/798864104ad8a4db6af136e8938eb43e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 15:10:26,109 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 798864104ad8a4db6af136e8938eb43e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70869526, jitterRate=0.056038230657577515}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 15:10:26,109 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 798864104ad8a4db6af136e8938eb43e: 2023-07-20 15:10:26,111 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689865825469.798864104ad8a4db6af136e8938eb43e., pid=6, masterSystemTime=1689865826062 2023-07-20 15:10:26,115 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689865825469.798864104ad8a4db6af136e8938eb43e. 2023-07-20 15:10:26,116 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689865825469.798864104ad8a4db6af136e8938eb43e. 2023-07-20 15:10:26,118 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=798864104ad8a4db6af136e8938eb43e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:10:26,118 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689865825469.798864104ad8a4db6af136e8938eb43e.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689865826117"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689865826117"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689865826117"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689865826117"}]},"ts":"1689865826117"} 2023-07-20 15:10:26,125 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-20 15:10:26,125 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 798864104ad8a4db6af136e8938eb43e, server=jenkins-hbase4.apache.org,41343,1689865822688 in 214 msec 2023-07-20 15:10:26,131 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-20 15:10:26,132 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=798864104ad8a4db6af136e8938eb43e, ASSIGN in 382 msec 2023-07-20 15:10:26,133 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-20 15:10:26,133 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689865826133"}]},"ts":"1689865826133"} 2023-07-20 15:10:26,135 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-20 15:10:26,139 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-20 15:10:26,146 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 668 msec 2023-07-20 15:10:26,187 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-20 15:10:26,190 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-20 15:10:26,190 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-20 15:10:26,214 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 15:10:26,217 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42674, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 15:10:26,235 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-20 15:10:26,257 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-20 15:10:26,264 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 40 msec 2023-07-20 15:10:26,269 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-20 15:10:26,281 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-20 15:10:26,287 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 18 msec 2023-07-20 15:10:26,295 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-20 15:10:26,299 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-20 15:10:26,301 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.541sec 2023-07-20 15:10:26,305 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-20 15:10:26,307 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-20 15:10:26,307 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-20 15:10:26,309 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38949,1689865821097-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-20 15:10:26,310 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38949,1689865821097-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-20 15:10:26,329 DEBUG [Listener at localhost/33785] zookeeper.ReadOnlyZKClient(139): Connect 0x095b019e to 127.0.0.1:64446 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 15:10:26,336 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-20 15:10:26,340 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-20 15:10:26,342 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-20 15:10:26,342 DEBUG [Listener at localhost/33785] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@572c911d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 15:10:26,344 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-20 15:10:26,349 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-07-20 15:10:26,352 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/hbase/acl/e594665f61777c3f9ce0929d721f11f9 2023-07-20 15:10:26,353 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/hbase/acl/e594665f61777c3f9ce0929d721f11f9 empty. 2023-07-20 15:10:26,355 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/hbase/acl/e594665f61777c3f9ce0929d721f11f9 2023-07-20 15:10:26,355 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-20 15:10:26,367 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-20 15:10:26,375 DEBUG [hconnection-0x30531378-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 15:10:26,412 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43766, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 15:10:26,413 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-20 15:10:26,416 INFO [Listener at localhost/33785] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,38949,1689865821097 2023-07-20 15:10:26,416 INFO [Listener at localhost/33785] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-07-20 15:10:26,416 INFO [Listener at localhost/33785] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a3c136b5-559e-274b-8286-a02c66f74c8f/test.cache.data in system properties and HBase conf 2023-07-20 15:10:26,416 INFO [Listener at localhost/33785] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a3c136b5-559e-274b-8286-a02c66f74c8f/hadoop.tmp.dir in system properties and HBase conf 2023-07-20 15:10:26,416 INFO [Listener at localhost/33785] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a3c136b5-559e-274b-8286-a02c66f74c8f/hadoop.log.dir in system properties and HBase conf 2023-07-20 15:10:26,416 INFO [Listener at localhost/33785] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a3c136b5-559e-274b-8286-a02c66f74c8f/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-20 15:10:26,416 INFO [Listener at localhost/33785] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a3c136b5-559e-274b-8286-a02c66f74c8f/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-20 15:10:26,416 INFO [Listener at localhost/33785] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-20 15:10:26,416 INFO [Listener at localhost/33785] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a3c136b5-559e-274b-8286-a02c66f74c8f/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-20 15:10:26,416 INFO [Listener at localhost/33785] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a3c136b5-559e-274b-8286-a02c66f74c8f/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-20 15:10:26,416 INFO [Listener at localhost/33785] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a3c136b5-559e-274b-8286-a02c66f74c8f/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-20 15:10:26,416 INFO [Listener at localhost/33785] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a3c136b5-559e-274b-8286-a02c66f74c8f/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-20 15:10:26,417 INFO [Listener at localhost/33785] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a3c136b5-559e-274b-8286-a02c66f74c8f/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-20 15:10:26,417 INFO [Listener at localhost/33785] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a3c136b5-559e-274b-8286-a02c66f74c8f/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-20 15:10:26,417 INFO [Listener at localhost/33785] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a3c136b5-559e-274b-8286-a02c66f74c8f/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-20 15:10:26,417 INFO [Listener at localhost/33785] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a3c136b5-559e-274b-8286-a02c66f74c8f/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-20 15:10:26,417 INFO [Listener at localhost/33785] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a3c136b5-559e-274b-8286-a02c66f74c8f/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-20 15:10:26,417 INFO [Listener at localhost/33785] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a3c136b5-559e-274b-8286-a02c66f74c8f/nfs.dump.dir in system properties and HBase conf 2023-07-20 15:10:26,417 INFO [Listener at localhost/33785] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a3c136b5-559e-274b-8286-a02c66f74c8f/java.io.tmpdir in system properties and HBase conf 2023-07-20 15:10:26,417 INFO [Listener at localhost/33785] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a3c136b5-559e-274b-8286-a02c66f74c8f/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-20 15:10:26,417 INFO [Listener at localhost/33785] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a3c136b5-559e-274b-8286-a02c66f74c8f/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-20 15:10:26,417 INFO [Listener at localhost/33785] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a3c136b5-559e-274b-8286-a02c66f74c8f/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-07-20 15:10:26,423 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => e594665f61777c3f9ce0929d721f11f9, NAME => 'hbase:acl,,1689865826331.e594665f61777c3f9ce0929d721f11f9.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp 2023-07-20 15:10:26,466 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689865826331.e594665f61777c3f9ce0929d721f11f9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 15:10:26,466 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing e594665f61777c3f9ce0929d721f11f9, disabling compactions & flushes 2023-07-20 15:10:26,466 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689865826331.e594665f61777c3f9ce0929d721f11f9. 2023-07-20 15:10:26,466 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689865826331.e594665f61777c3f9ce0929d721f11f9. 2023-07-20 15:10:26,466 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689865826331.e594665f61777c3f9ce0929d721f11f9. after waiting 0 ms 2023-07-20 15:10:26,467 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689865826331.e594665f61777c3f9ce0929d721f11f9. 2023-07-20 15:10:26,467 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1689865826331.e594665f61777c3f9ce0929d721f11f9. 2023-07-20 15:10:26,467 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for e594665f61777c3f9ce0929d721f11f9: 2023-07-20 15:10:26,475 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-20 15:10:26,477 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-20 15:10:26,486 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1689865826331.e594665f61777c3f9ce0929d721f11f9.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689865826486"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689865826486"}]},"ts":"1689865826486"} 2023-07-20 15:10:26,491 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-20 15:10:26,493 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-20 15:10:26,494 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689865826493"}]},"ts":"1689865826493"} 2023-07-20 15:10:26,500 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-20 15:10:26,506 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-20 15:10:26,508 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-20 15:10:26,508 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-20 15:10:26,508 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-20 15:10:26,508 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-20 15:10:26,509 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=e594665f61777c3f9ce0929d721f11f9, ASSIGN}] 2023-07-20 15:10:26,513 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=e594665f61777c3f9ce0929d721f11f9, ASSIGN 2023-07-20 15:10:26,515 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=e594665f61777c3f9ce0929d721f11f9, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41343,1689865822688; forceNewPlan=false, retain=false 2023-07-20 15:10:26,666 INFO [jenkins-hbase4:38949] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-20 15:10:26,667 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=e594665f61777c3f9ce0929d721f11f9, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:10:26,667 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1689865826331.e594665f61777c3f9ce0929d721f11f9.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689865826667"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689865826667"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689865826667"}]},"ts":"1689865826667"} 2023-07-20 15:10:26,671 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure e594665f61777c3f9ce0929d721f11f9, server=jenkins-hbase4.apache.org,41343,1689865822688}] 2023-07-20 15:10:26,680 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-20 15:10:26,840 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1689865826331.e594665f61777c3f9ce0929d721f11f9. 2023-07-20 15:10:26,841 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e594665f61777c3f9ce0929d721f11f9, NAME => 'hbase:acl,,1689865826331.e594665f61777c3f9ce0929d721f11f9.', STARTKEY => '', ENDKEY => ''} 2023-07-20 15:10:26,841 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1689865826331.e594665f61777c3f9ce0929d721f11f9. service=AccessControlService 2023-07-20 15:10:26,841 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 15:10:26,842 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl e594665f61777c3f9ce0929d721f11f9 2023-07-20 15:10:26,842 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689865826331.e594665f61777c3f9ce0929d721f11f9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 15:10:26,842 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e594665f61777c3f9ce0929d721f11f9 2023-07-20 15:10:26,842 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e594665f61777c3f9ce0929d721f11f9 2023-07-20 15:10:26,859 INFO [StoreOpener-e594665f61777c3f9ce0929d721f11f9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region e594665f61777c3f9ce0929d721f11f9 2023-07-20 15:10:26,864 DEBUG [StoreOpener-e594665f61777c3f9ce0929d721f11f9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/hbase/acl/e594665f61777c3f9ce0929d721f11f9/l 2023-07-20 15:10:26,864 DEBUG [StoreOpener-e594665f61777c3f9ce0929d721f11f9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/hbase/acl/e594665f61777c3f9ce0929d721f11f9/l 2023-07-20 15:10:26,865 INFO [StoreOpener-e594665f61777c3f9ce0929d721f11f9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e594665f61777c3f9ce0929d721f11f9 columnFamilyName l 2023-07-20 15:10:26,866 INFO [StoreOpener-e594665f61777c3f9ce0929d721f11f9-1] regionserver.HStore(310): Store=e594665f61777c3f9ce0929d721f11f9/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 15:10:26,868 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/hbase/acl/e594665f61777c3f9ce0929d721f11f9 2023-07-20 15:10:26,870 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/hbase/acl/e594665f61777c3f9ce0929d721f11f9 2023-07-20 15:10:26,876 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e594665f61777c3f9ce0929d721f11f9 2023-07-20 15:10:26,881 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/hbase/acl/e594665f61777c3f9ce0929d721f11f9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 15:10:26,882 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e594665f61777c3f9ce0929d721f11f9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60840113, jitterRate=-0.09341166913509369}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 15:10:26,882 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e594665f61777c3f9ce0929d721f11f9: 2023-07-20 15:10:26,884 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1689865826331.e594665f61777c3f9ce0929d721f11f9., pid=11, masterSystemTime=1689865826826 2023-07-20 15:10:26,887 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1689865826331.e594665f61777c3f9ce0929d721f11f9. 2023-07-20 15:10:26,888 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1689865826331.e594665f61777c3f9ce0929d721f11f9. 2023-07-20 15:10:26,888 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=e594665f61777c3f9ce0929d721f11f9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:10:26,889 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1689865826331.e594665f61777c3f9ce0929d721f11f9.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689865826888"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689865826888"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689865826888"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689865826888"}]},"ts":"1689865826888"} 2023-07-20 15:10:26,896 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-20 15:10:26,896 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure e594665f61777c3f9ce0929d721f11f9, server=jenkins-hbase4.apache.org,41343,1689865822688 in 221 msec 2023-07-20 15:10:26,901 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-20 15:10:26,901 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=e594665f61777c3f9ce0929d721f11f9, ASSIGN in 388 msec 2023-07-20 15:10:26,905 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-20 15:10:26,906 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689865826905"}]},"ts":"1689865826905"} 2023-07-20 15:10:26,908 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-20 15:10:26,914 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-20 15:10:26,917 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 578 msec 2023-07-20 15:10:26,981 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-20 15:10:26,981 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-07-20 15:10:27,002 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-20 15:10:27,838 WARN [Thread-384] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-20 15:10:28,135 INFO [Thread-384] log.Slf4jLog(67): jetty-6.1.26 2023-07-20 15:10:28,140 INFO [Thread-384] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a3c136b5-559e-274b-8286-a02c66f74c8f/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_38533_jobhistory____pssdtl/webapp 2023-07-20 15:10:28,314 INFO [Thread-384] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-07-20 15:10:28,314 INFO [Thread-384] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-07-20 15:10:28,314 INFO [Thread-384] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-20 15:10:28,317 INFO [Thread-384] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-20 15:10:28,397 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-20 15:10:28,711 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-20 15:10:29,017 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-07-20 15:10:29,053 INFO [Thread-384] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:38533 2023-07-20 15:10:29,334 WARN [Listener at jenkins-hbase4.apache.org/36641] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-20 15:10:29,731 WARN [Listener at jenkins-hbase4.apache.org/36641] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-20 15:10:29,731 INFO [Listener at jenkins-hbase4.apache.org/36641] log.Slf4jLog(67): jetty-6.1.26 2023-07-20 15:10:29,741 INFO [Listener at jenkins-hbase4.apache.org/36641] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a3c136b5-559e-274b-8286-a02c66f74c8f/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_45163_cluster____.ali96x/webapp 2023-07-20 15:10:29,817 INFO [Listener at jenkins-hbase4.apache.org/36641] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-07-20 15:10:29,817 INFO [Listener at jenkins-hbase4.apache.org/36641] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-07-20 15:10:29,818 INFO [Listener at jenkins-hbase4.apache.org/36641] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-20 15:10:29,818 INFO [Listener at jenkins-hbase4.apache.org/36641] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-20 15:10:29,827 INFO [Listener at jenkins-hbase4.apache.org/36641] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-20 15:10:30,022 INFO [Listener at jenkins-hbase4.apache.org/36641] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-20 15:10:30,142 INFO [Listener at jenkins-hbase4.apache.org/36641] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-20 15:10:30,175 INFO [Listener at jenkins-hbase4.apache.org/36641] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:45163 2023-07-20 15:10:30,670 WARN [Listener at jenkins-hbase4.apache.org/41267] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-20 15:10:30,695 WARN [Listener at jenkins-hbase4.apache.org/41267] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-20 15:10:30,696 INFO [Listener at jenkins-hbase4.apache.org/41267] log.Slf4jLog(67): jetty-6.1.26 2023-07-20 15:10:30,703 INFO [Listener at jenkins-hbase4.apache.org/41267] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a3c136b5-559e-274b-8286-a02c66f74c8f/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_46335_node____odsmkx/webapp 2023-07-20 15:10:30,737 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-20 15:10:30,773 INFO [Listener at jenkins-hbase4.apache.org/41267] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-20 15:10:30,774 INFO [Listener at jenkins-hbase4.apache.org/41267] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-20 15:10:30,774 INFO [Listener at jenkins-hbase4.apache.org/41267] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-20 15:10:30,774 INFO [Listener at jenkins-hbase4.apache.org/41267] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-20 15:10:30,811 INFO [Listener at jenkins-hbase4.apache.org/41267] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-20 15:10:30,840 INFO [Listener at jenkins-hbase4.apache.org/41267] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-20 15:10:30,893 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-20 15:10:30,895 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-20 15:10:30,896 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-20 15:10:30,943 INFO [Listener at jenkins-hbase4.apache.org/41267] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-20 15:10:30,955 INFO [Listener at jenkins-hbase4.apache.org/41267] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:46335 2023-07-20 15:10:31,268 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 15:10:31,269 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-20 15:10:31,269 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 15:10:31,269 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-20 15:10:31,269 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-20 15:10:31,269 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-20 15:10:31,270 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 15:10:31,270 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-20 15:10:31,270 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-20 15:10:31,270 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-20 15:10:31,318 WARN [Listener at jenkins-hbase4.apache.org/33267] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-20 15:10:31,328 WARN [Listener at jenkins-hbase4.apache.org/33267] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-20 15:10:31,329 INFO [Listener at jenkins-hbase4.apache.org/33267] log.Slf4jLog(67): jetty-6.1.26 2023-07-20 15:10:31,340 INFO [Listener at jenkins-hbase4.apache.org/33267] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a3c136b5-559e-274b-8286-a02c66f74c8f/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_43827_node____py24f0/webapp 2023-07-20 15:10:31,394 INFO [Listener at jenkins-hbase4.apache.org/33267] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-20 15:10:31,394 INFO [Listener at jenkins-hbase4.apache.org/33267] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-20 15:10:31,394 INFO [Listener at jenkins-hbase4.apache.org/33267] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-20 15:10:31,394 INFO [Listener at jenkins-hbase4.apache.org/33267] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-20 15:10:31,403 INFO [Listener at jenkins-hbase4.apache.org/33267] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-20 15:10:31,419 INFO [Listener at jenkins-hbase4.apache.org/33267] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-20 15:10:31,507 INFO [Listener at jenkins-hbase4.apache.org/33267] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-20 15:10:31,512 INFO [Listener at jenkins-hbase4.apache.org/33267] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:43827 2023-07-20 15:10:31,556 INFO [Listener at jenkins-hbase4.apache.org/33267] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-07-20 15:10:31,559 INFO [Listener at jenkins-hbase4.apache.org/33267] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-20 15:10:31,651 INFO [Listener at jenkins-hbase4.apache.org/33267] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=704, OpenFileDescriptor=906, MaxFileDescriptor=60000, SystemLoadAverage=265, ProcessCount=177, AvailableMemoryMB=5252 2023-07-20 15:10:31,651 WARN [Listener at jenkins-hbase4.apache.org/33267] hbase.ResourceChecker(130): Thread=704 is superior to 500 2023-07-20 15:10:31,667 DEBUG [Listener at jenkins-hbase4.apache.org/33267] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-20 15:10:31,685 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60174, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-20 15:10:31,696 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-20 15:10:31,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-07-20 15:10:31,703 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-07-20 15:10:31,706 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-07-20 15:10:31,707 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-20 15:10:31,728 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testExportWithTargetName/291ff7a49a05762b225e6fe0f08cecf9 2023-07-20 15:10:31,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-20 15:10:31,729 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testExportWithTargetName/291ff7a49a05762b225e6fe0f08cecf9 empty. 2023-07-20 15:10:31,739 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testExportWithTargetName/073d257db14973a57fbb43dbbac389c0 2023-07-20 15:10:31,745 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testExportWithTargetName/291ff7a49a05762b225e6fe0f08cecf9 2023-07-20 15:10:31,745 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testExportWithTargetName/073d257db14973a57fbb43dbbac389c0 empty. 2023-07-20 15:10:31,747 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testExportWithTargetName/073d257db14973a57fbb43dbbac389c0 2023-07-20 15:10:31,747 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-20 15:10:31,799 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-07-20 15:10:31,801 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => 073d257db14973a57fbb43dbbac389c0, NAME => 'testtb-testExportWithTargetName,,1689865831696.073d257db14973a57fbb43dbbac389c0.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp 2023-07-20 15:10:31,801 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => 291ff7a49a05762b225e6fe0f08cecf9, NAME => 'testtb-testExportWithTargetName,1,1689865831696.291ff7a49a05762b225e6fe0f08cecf9.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp 2023-07-20 15:10:31,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-20 15:10:31,861 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689865831696.291ff7a49a05762b225e6fe0f08cecf9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 15:10:31,862 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing 291ff7a49a05762b225e6fe0f08cecf9, disabling compactions & flushes 2023-07-20 15:10:31,862 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689865831696.291ff7a49a05762b225e6fe0f08cecf9. 2023-07-20 15:10:31,862 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689865831696.291ff7a49a05762b225e6fe0f08cecf9. 2023-07-20 15:10:31,862 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689865831696.291ff7a49a05762b225e6fe0f08cecf9. after waiting 0 ms 2023-07-20 15:10:31,862 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689865831696.291ff7a49a05762b225e6fe0f08cecf9. 2023-07-20 15:10:31,862 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689865831696.291ff7a49a05762b225e6fe0f08cecf9. 2023-07-20 15:10:31,862 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for 291ff7a49a05762b225e6fe0f08cecf9: 2023-07-20 15:10:31,862 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689865831696.073d257db14973a57fbb43dbbac389c0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 15:10:31,863 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing 073d257db14973a57fbb43dbbac389c0, disabling compactions & flushes 2023-07-20 15:10:31,863 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689865831696.073d257db14973a57fbb43dbbac389c0. 2023-07-20 15:10:31,863 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689865831696.073d257db14973a57fbb43dbbac389c0. 2023-07-20 15:10:31,863 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689865831696.073d257db14973a57fbb43dbbac389c0. after waiting 0 ms 2023-07-20 15:10:31,863 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689865831696.073d257db14973a57fbb43dbbac389c0. 2023-07-20 15:10:31,863 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689865831696.073d257db14973a57fbb43dbbac389c0. 2023-07-20 15:10:31,863 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for 073d257db14973a57fbb43dbbac389c0: 2023-07-20 15:10:31,867 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-07-20 15:10:31,869 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689865831696.291ff7a49a05762b225e6fe0f08cecf9.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689865831868"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689865831868"}]},"ts":"1689865831868"} 2023-07-20 15:10:31,869 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689865831696.073d257db14973a57fbb43dbbac389c0.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689865831868"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689865831868"}]},"ts":"1689865831868"} 2023-07-20 15:10:31,927 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-20 15:10:31,928 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-20 15:10:31,929 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689865831929"}]},"ts":"1689865831929"} 2023-07-20 15:10:31,931 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-07-20 15:10:31,937 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-20 15:10:31,939 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-20 15:10:31,939 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-20 15:10:31,940 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-20 15:10:31,940 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-20 15:10:31,940 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=073d257db14973a57fbb43dbbac389c0, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=291ff7a49a05762b225e6fe0f08cecf9, ASSIGN}] 2023-07-20 15:10:31,943 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=291ff7a49a05762b225e6fe0f08cecf9, ASSIGN 2023-07-20 15:10:31,944 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=073d257db14973a57fbb43dbbac389c0, ASSIGN 2023-07-20 15:10:31,946 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=291ff7a49a05762b225e6fe0f08cecf9, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46155,1689865822636; forceNewPlan=false, retain=false 2023-07-20 15:10:31,946 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=073d257db14973a57fbb43dbbac389c0, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37315,1689865822568; forceNewPlan=false, retain=false 2023-07-20 15:10:32,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-20 15:10:32,096 INFO [jenkins-hbase4:38949] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-20 15:10:32,098 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=291ff7a49a05762b225e6fe0f08cecf9, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:10:32,098 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=073d257db14973a57fbb43dbbac389c0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:10:32,099 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689865831696.291ff7a49a05762b225e6fe0f08cecf9.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689865832098"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689865832098"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689865832098"}]},"ts":"1689865832098"} 2023-07-20 15:10:32,099 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689865831696.073d257db14973a57fbb43dbbac389c0.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689865832098"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689865832098"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689865832098"}]},"ts":"1689865832098"} 2023-07-20 15:10:32,102 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE; OpenRegionProcedure 291ff7a49a05762b225e6fe0f08cecf9, server=jenkins-hbase4.apache.org,46155,1689865822636}] 2023-07-20 15:10:32,111 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=13, state=RUNNABLE; OpenRegionProcedure 073d257db14973a57fbb43dbbac389c0, server=jenkins-hbase4.apache.org,37315,1689865822568}] 2023-07-20 15:10:32,256 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:10:32,256 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-20 15:10:32,260 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53426, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-20 15:10:32,267 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1689865831696.291ff7a49a05762b225e6fe0f08cecf9. 2023-07-20 15:10:32,267 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 291ff7a49a05762b225e6fe0f08cecf9, NAME => 'testtb-testExportWithTargetName,1,1689865831696.291ff7a49a05762b225e6fe0f08cecf9.', STARTKEY => '1', ENDKEY => ''} 2023-07-20 15:10:32,267 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1689865831696.291ff7a49a05762b225e6fe0f08cecf9. service=AccessControlService 2023-07-20 15:10:32,268 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 15:10:32,268 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1689865831696.073d257db14973a57fbb43dbbac389c0. 2023-07-20 15:10:32,268 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 291ff7a49a05762b225e6fe0f08cecf9 2023-07-20 15:10:32,268 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 073d257db14973a57fbb43dbbac389c0, NAME => 'testtb-testExportWithTargetName,,1689865831696.073d257db14973a57fbb43dbbac389c0.', STARTKEY => '', ENDKEY => '1'} 2023-07-20 15:10:32,268 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689865831696.291ff7a49a05762b225e6fe0f08cecf9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 15:10:32,268 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 291ff7a49a05762b225e6fe0f08cecf9 2023-07-20 15:10:32,268 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 291ff7a49a05762b225e6fe0f08cecf9 2023-07-20 15:10:32,268 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1689865831696.073d257db14973a57fbb43dbbac389c0. service=AccessControlService 2023-07-20 15:10:32,268 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 15:10:32,268 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 073d257db14973a57fbb43dbbac389c0 2023-07-20 15:10:32,268 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689865831696.073d257db14973a57fbb43dbbac389c0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 15:10:32,268 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 073d257db14973a57fbb43dbbac389c0 2023-07-20 15:10:32,269 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 073d257db14973a57fbb43dbbac389c0 2023-07-20 15:10:32,271 INFO [StoreOpener-291ff7a49a05762b225e6fe0f08cecf9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 291ff7a49a05762b225e6fe0f08cecf9 2023-07-20 15:10:32,271 INFO [StoreOpener-073d257db14973a57fbb43dbbac389c0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 073d257db14973a57fbb43dbbac389c0 2023-07-20 15:10:32,273 DEBUG [StoreOpener-291ff7a49a05762b225e6fe0f08cecf9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportWithTargetName/291ff7a49a05762b225e6fe0f08cecf9/cf 2023-07-20 15:10:32,273 DEBUG [StoreOpener-291ff7a49a05762b225e6fe0f08cecf9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportWithTargetName/291ff7a49a05762b225e6fe0f08cecf9/cf 2023-07-20 15:10:32,274 DEBUG [StoreOpener-073d257db14973a57fbb43dbbac389c0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportWithTargetName/073d257db14973a57fbb43dbbac389c0/cf 2023-07-20 15:10:32,274 DEBUG [StoreOpener-073d257db14973a57fbb43dbbac389c0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportWithTargetName/073d257db14973a57fbb43dbbac389c0/cf 2023-07-20 15:10:32,277 INFO [StoreOpener-291ff7a49a05762b225e6fe0f08cecf9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 291ff7a49a05762b225e6fe0f08cecf9 columnFamilyName cf 2023-07-20 15:10:32,277 INFO [StoreOpener-073d257db14973a57fbb43dbbac389c0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 073d257db14973a57fbb43dbbac389c0 columnFamilyName cf 2023-07-20 15:10:32,280 INFO [StoreOpener-291ff7a49a05762b225e6fe0f08cecf9-1] regionserver.HStore(310): Store=291ff7a49a05762b225e6fe0f08cecf9/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 15:10:32,280 INFO [StoreOpener-073d257db14973a57fbb43dbbac389c0-1] regionserver.HStore(310): Store=073d257db14973a57fbb43dbbac389c0/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 15:10:32,284 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportWithTargetName/291ff7a49a05762b225e6fe0f08cecf9 2023-07-20 15:10:32,285 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportWithTargetName/073d257db14973a57fbb43dbbac389c0 2023-07-20 15:10:32,285 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportWithTargetName/291ff7a49a05762b225e6fe0f08cecf9 2023-07-20 15:10:32,285 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportWithTargetName/073d257db14973a57fbb43dbbac389c0 2023-07-20 15:10:32,291 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 291ff7a49a05762b225e6fe0f08cecf9 2023-07-20 15:10:32,291 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 073d257db14973a57fbb43dbbac389c0 2023-07-20 15:10:32,299 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportWithTargetName/291ff7a49a05762b225e6fe0f08cecf9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 15:10:32,300 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportWithTargetName/073d257db14973a57fbb43dbbac389c0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 15:10:32,303 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 291ff7a49a05762b225e6fe0f08cecf9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66940653, jitterRate=-0.002506539225578308}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 15:10:32,303 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 073d257db14973a57fbb43dbbac389c0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70389366, jitterRate=0.048883289098739624}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 15:10:32,303 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 291ff7a49a05762b225e6fe0f08cecf9: 2023-07-20 15:10:32,303 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 073d257db14973a57fbb43dbbac389c0: 2023-07-20 15:10:32,311 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1689865831696.291ff7a49a05762b225e6fe0f08cecf9., pid=15, masterSystemTime=1689865832256 2023-07-20 15:10:32,312 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1689865831696.073d257db14973a57fbb43dbbac389c0., pid=16, masterSystemTime=1689865832263 2023-07-20 15:10:32,317 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1689865831696.291ff7a49a05762b225e6fe0f08cecf9. 2023-07-20 15:10:32,318 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=291ff7a49a05762b225e6fe0f08cecf9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:10:32,318 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1689865831696.291ff7a49a05762b225e6fe0f08cecf9.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689865832318"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689865832318"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689865832318"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689865832318"}]},"ts":"1689865832318"} 2023-07-20 15:10:32,320 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1689865831696.291ff7a49a05762b225e6fe0f08cecf9. 2023-07-20 15:10:32,320 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1689865831696.073d257db14973a57fbb43dbbac389c0. 2023-07-20 15:10:32,323 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1689865831696.073d257db14973a57fbb43dbbac389c0. 2023-07-20 15:10:32,325 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=073d257db14973a57fbb43dbbac389c0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:10:32,326 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1689865831696.073d257db14973a57fbb43dbbac389c0.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689865832325"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689865832325"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689865832325"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689865832325"}]},"ts":"1689865832325"} 2023-07-20 15:10:32,336 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=14 2023-07-20 15:10:32,336 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=14, state=SUCCESS; OpenRegionProcedure 291ff7a49a05762b225e6fe0f08cecf9, server=jenkins-hbase4.apache.org,46155,1689865822636 in 225 msec 2023-07-20 15:10:32,338 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=13 2023-07-20 15:10:32,339 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=13, state=SUCCESS; OpenRegionProcedure 073d257db14973a57fbb43dbbac389c0, server=jenkins-hbase4.apache.org,37315,1689865822568 in 219 msec 2023-07-20 15:10:32,341 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=291ff7a49a05762b225e6fe0f08cecf9, ASSIGN in 396 msec 2023-07-20 15:10:32,343 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=13, resume processing ppid=12 2023-07-20 15:10:32,344 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=073d257db14973a57fbb43dbbac389c0, ASSIGN in 398 msec 2023-07-20 15:10:32,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-20 15:10:32,345 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-20 15:10:32,345 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689865832345"}]},"ts":"1689865832345"} 2023-07-20 15:10:32,347 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-07-20 15:10:32,350 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-07-20 15:10:32,357 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-07-20 15:10:32,368 DEBUG [hconnection-0x307a7af3-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 15:10:32,372 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49532, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=ClientService 2023-07-20 15:10:32,382 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41343] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-20 15:10:32,427 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-20 15:10:32,427 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-20 15:10:32,427 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-20 15:10:32,427 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-20 15:10:32,427 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-20 15:10:32,447 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-20 15:10:32,448 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-20 15:10:32,449 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-20 15:10:32,449 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-20 15:10:32,450 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-20 15:10:32,454 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-20 15:10:32,455 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 754 msec 2023-07-20 15:10:32,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-20 15:10:32,847 INFO [Listener at jenkins-hbase4.apache.org/33267] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-07-20 15:10:32,852 DEBUG [Listener at jenkins-hbase4.apache.org/33267] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-20 15:10:32,854 DEBUG [Listener at jenkins-hbase4.apache.org/33267] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689865831696.073d257db14973a57fbb43dbbac389c0. 2023-07-20 15:10:32,856 INFO [Listener at jenkins-hbase4.apache.org/33267] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-20 15:10:32,892 DEBUG [hconnection-0x30531378-shared-pool-5] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 15:10:32,899 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53428, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 15:10:32,919 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-20 15:10:32,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689865832920 (current time:1689865832920). 2023-07-20 15:10:32,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-20 15:10:32,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] zookeeper.ReadOnlyZKClient(139): Connect 0x3b939c6c to 127.0.0.1:64446 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 15:10:32,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@e311cc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 15:10:32,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 15:10:32,935 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49546, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 15:10:32,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3b939c6c to 127.0.0.1:64446 2023-07-20 15:10:32,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 15:10:32,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] zookeeper.ReadOnlyZKClient(139): Connect 0x113a3aa4 to 127.0.0.1:64446 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 15:10:32,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1452670c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 15:10:33,046 DEBUG [hconnection-0x21d9bd97-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 15:10:33,049 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49558, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 15:10:33,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 15:10:33,058 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38264, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 15:10:33,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x113a3aa4 to 127.0.0.1:64446 2023-07-20 15:10:33,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 15:10:33,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-20 15:10:33,086 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-20 15:10:33,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-20 15:10:33,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] procedure2.ProcedureExecutor(1029): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-20 15:10:33,118 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-20 15:10:33,120 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689866433120 2023-07-20 15:10:33,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-20 15:10:33,120 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-20 15:10:33,124 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-20 15:10:33,125 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-20 15:10:33,127 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 18 msec 2023-07-20 15:10:33,128 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-20 15:10:33,129 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689866433129 2023-07-20 15:10:33,129 DEBUG [Listener at jenkins-hbase4.apache.org/33267] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-20 15:10:33,129 DEBUG [Listener at jenkins-hbase4.apache.org/33267] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-20 15:10:33,154 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:33,154 INFO [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-07-20 15:10:33,154 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 15:10:33,155 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-07-20 15:10:33,155 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-20 15:10:33,156 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:33,156 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:33,164 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:10:33,164 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:10:33,165 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:10:33,165 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:10:33,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:10:33,165 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:10:33,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:10:33,164 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:10:33,165 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:10:33,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:10:33,165 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:10:33,165 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:10:33,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:33,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:33,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:33,166 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:33,167 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:33,167 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:33,167 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:10:33,167 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-20 15:10:33,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-20 15:10:33,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-20 15:10:33,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-20 15:10:33,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:33,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:33,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:33,169 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-20 15:10:33,169 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-20 15:10:33,169 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-20 15:10:33,173 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:33,177 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:33,178 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:33,178 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-20 15:10:33,178 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-20 15:10:33,178 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 15:10:33,178 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 15:10:33,178 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-20 15:10:33,180 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-20 15:10:33,180 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 15:10:33,179 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-20 15:10:33,180 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-20 15:10:33,180 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-20 15:10:33,180 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-20 15:10:33,180 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-20 15:10:33,181 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41343,1689865822688' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-20 15:10:33,181 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37315,1689865822568' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-20 15:10:33,181 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46155,1689865822636' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-20 15:10:33,183 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:33,184 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:10:33,184 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:33,184 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:33,184 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:33,184 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 15:10:33,184 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:10:33,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:10:33,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:10:33,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:10:33,184 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:33,185 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 15:10:33,184 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:33,185 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 15:10:33,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:10:33,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:10:33,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:33,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:10:33,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:10:33,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:10:33,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:10:33,188 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37315,1689865822568' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-20 15:10:33,188 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5526fa1c[Count = 1] remaining members to acquire global barrier 2023-07-20 15:10:33,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:10:33,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:10:33,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:10:33,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:10:33,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:10:33,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:33,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:10:33,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:10:33,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:10:33,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:10:33,192 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46155,1689865822636' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-20 15:10:33,192 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5526fa1c[Count = 0] remaining members to acquire global barrier 2023-07-20 15:10:33,192 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-20 15:10:33,192 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:33,194 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:33,194 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:33,194 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:33,194 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:33,194 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:33,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:33,194 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:33,195 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-20 15:10:33,195 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:10:33,195 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-20 15:10:33,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:33,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:33,195 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-20 15:10:33,195 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,41343,1689865822688' in zk 2023-07-20 15:10:33,195 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-20 15:10:33,198 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 15:10:33,198 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:10:33,198 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 15:10:33,198 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 15:10:33,198 DEBUG [rs(jenkins-hbase4.apache.org,46155,1689865822636)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689865831696.291ff7a49a05762b225e6fe0f08cecf9. 2023-07-20 15:10:33,198 DEBUG [rs(jenkins-hbase4.apache.org,37315,1689865822568)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689865831696.073d257db14973a57fbb43dbbac389c0. 2023-07-20 15:10:33,198 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 15:10:33,199 DEBUG [rs(jenkins-hbase4.apache.org,46155,1689865822636)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689865831696.291ff7a49a05762b225e6fe0f08cecf9. started... 2023-07-20 15:10:33,198 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-20 15:10:33,202 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-20 15:10:33,202 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 15:10:33,202 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-20 15:10:33,199 DEBUG [rs(jenkins-hbase4.apache.org,37315,1689865822568)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689865831696.073d257db14973a57fbb43dbbac389c0. started... 2023-07-20 15:10:33,204 DEBUG [rs(jenkins-hbase4.apache.org,46155,1689865822636)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 291ff7a49a05762b225e6fe0f08cecf9: 2023-07-20 15:10:33,204 DEBUG [rs(jenkins-hbase4.apache.org,37315,1689865822568)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 073d257db14973a57fbb43dbbac389c0: 2023-07-20 15:10:33,205 DEBUG [rs(jenkins-hbase4.apache.org,46155,1689865822636)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689865831696.291ff7a49a05762b225e6fe0f08cecf9.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:33,205 DEBUG [rs(jenkins-hbase4.apache.org,37315,1689865822568)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689865831696.073d257db14973a57fbb43dbbac389c0.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:33,210 DEBUG [rs(jenkins-hbase4.apache.org,37315,1689865822568)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 15:10:33,210 DEBUG [rs(jenkins-hbase4.apache.org,46155,1689865822636)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 15:10:33,216 DEBUG [rs(jenkins-hbase4.apache.org,46155,1689865822636)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-20 15:10:33,216 DEBUG [rs(jenkins-hbase4.apache.org,37315,1689865822568)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-20 15:10:33,229 DEBUG [Listener at jenkins-hbase4.apache.org/33267] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 15:10:33,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-20 15:10:33,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-20 15:10:33,243 DEBUG [Listener at jenkins-hbase4.apache.org/33267] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-20 15:10:33,255 DEBUG [rs(jenkins-hbase4.apache.org,37315,1689865822568)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689865831696.073d257db14973a57fbb43dbbac389c0. completed. 2023-07-20 15:10:33,256 DEBUG [rs(jenkins-hbase4.apache.org,37315,1689865822568)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689865831696.073d257db14973a57fbb43dbbac389c0. 2023-07-20 15:10:33,256 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 15:10:33,256 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 15:10:33,256 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:10:33,256 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-20 15:10:33,256 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,37315,1689865822568' in zk 2023-07-20 15:10:33,259 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-20 15:10:33,259 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:10:33,259 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 15:10:33,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:10:33,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:10:33,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:10:33,259 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-20 15:10:33,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:10:33,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:10:33,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:33,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:10:33,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:10:33,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:10:33,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:10:33,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:33,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:10:33,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:10:33,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,37315,1689865822568': 2023-07-20 15:10:33,268 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37315,1689865822568' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-20 15:10:33,443 DEBUG [Listener at jenkins-hbase4.apache.org/33267] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 15:10:33,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-20 15:10:33,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-20 15:10:33,445 DEBUG [Listener at jenkins-hbase4.apache.org/33267] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-20 15:10:33,656 DEBUG [rs(jenkins-hbase4.apache.org,46155,1689865822636)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689865831696.291ff7a49a05762b225e6fe0f08cecf9. completed. 2023-07-20 15:10:33,656 DEBUG [rs(jenkins-hbase4.apache.org,46155,1689865822636)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689865831696.291ff7a49a05762b225e6fe0f08cecf9. 2023-07-20 15:10:33,656 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 15:10:33,657 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 15:10:33,657 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:10:33,657 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-20 15:10:33,657 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,46155,1689865822636' in zk 2023-07-20 15:10:33,659 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-20 15:10:33,659 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:10:33,659 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 15:10:33,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:10:33,659 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-20 15:10:33,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:10:33,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:10:33,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:10:33,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:10:33,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:33,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:10:33,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:10:33,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:10:33,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:10:33,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:33,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:10:33,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:10:33,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:10:33,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,46155,1689865822636': 2023-07-20 15:10:33,666 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46155,1689865822636' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-20 15:10:33,666 INFO [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-07-20 15:10:33,666 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-20 15:10:33,666 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-20 15:10:33,666 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:33,667 INFO [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-20 15:10:33,672 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:33,672 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:33,672 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:33,672 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:33,672 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:33,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:33,672 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:33,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:33,672 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:10:33,672 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:10:33,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:33,673 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:10:33,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:10:33,672 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:10:33,673 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:10:33,673 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:10:33,673 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:33,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:33,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:10:33,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:10:33,674 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:10:33,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:10:33,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:33,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:10:33,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:33,674 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:10:33,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:10:33,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:33,675 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:10:33,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:33,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:10:33,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:33,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:10:33,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:10:33,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:10:33,679 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:10:33,679 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:10:33,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:10:33,680 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:10:33,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:33,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:10:33,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:10:33,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:10:33,698 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:10:33,698 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:10:33,698 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:10:33,698 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:10:33,698 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:33,698 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:10:33,698 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:10:33,698 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:10:33,698 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:10:33,699 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:33,698 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:10:33,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:10:33,699 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:10:33,699 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:10:33,699 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 15:10:33,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:10:33,699 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:33,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:10:33,699 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:10:33,699 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-07-20 15:10:33,700 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:10:33,700 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:33,700 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:33,700 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:10:33,700 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:10:33,701 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:10:33,701 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:10:33,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:10:33,700 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-20 15:10:33,701 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:33,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:10:33,701 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:33,702 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-20 15:10:33,703 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:10:33,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:10:33,724 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:33,727 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:33,745 DEBUG [Listener at jenkins-hbase4.apache.org/33267] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 15:10:33,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-20 15:10:33,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-20 15:10:33,747 DEBUG [Listener at jenkins-hbase4.apache.org/33267] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-20 15:10:33,775 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:33,818 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-20 15:10:33,818 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:33,818 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:33,819 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689865833121Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1689865833724 (+603 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1689865833724Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1689865833725 (+1 ms)Writing data manifest for emptySnaptb0-testExportWithTargetName at 1689865833740 (+15 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1689865833764 (+24 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689865833818 (+54 ms) 2023-07-20 15:10:33,821 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-20 15:10:33,823 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 699 msec 2023-07-20 15:10:34,247 DEBUG [Listener at jenkins-hbase4.apache.org/33267] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 15:10:34,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-20 15:10:34,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-20 15:10:34,271 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37315] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1689865831696.073d257db14973a57fbb43dbbac389c0. with WAL disabled. Data may be lost in the event of a crash. 2023-07-20 15:10:34,273 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46155] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1689865831696.291ff7a49a05762b225e6fe0f08cecf9. with WAL disabled. Data may be lost in the event of a crash. 2023-07-20 15:10:34,279 DEBUG [Listener at jenkins-hbase4.apache.org/33267] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-20 15:10:34,279 DEBUG [Listener at jenkins-hbase4.apache.org/33267] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689865831696.073d257db14973a57fbb43dbbac389c0. 2023-07-20 15:10:34,279 INFO [Listener at jenkins-hbase4.apache.org/33267] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-20 15:10:34,297 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-20 15:10:34,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689865834297 (current time:1689865834297). 2023-07-20 15:10:34,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-20 15:10:34,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] zookeeper.ReadOnlyZKClient(139): Connect 0x1c03d3c2 to 127.0.0.1:64446 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 15:10:34,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@52b72573, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 15:10:34,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 15:10:34,313 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49566, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 15:10:34,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1c03d3c2 to 127.0.0.1:64446 2023-07-20 15:10:34,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 15:10:34,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] zookeeper.ReadOnlyZKClient(139): Connect 0x4fe6a566 to 127.0.0.1:64446 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 15:10:34,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4d79e29b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 15:10:34,326 DEBUG [hconnection-0x268edafa-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 15:10:34,330 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49568, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 15:10:34,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 15:10:34,341 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38276, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 15:10:34,343 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4fe6a566 to 127.0.0.1:64446 2023-07-20 15:10:34,343 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 15:10:34,343 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-20 15:10:34,344 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-20 15:10:34,344 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-20 15:10:34,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-20 15:10:34,350 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-20 15:10:34,351 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689866434351 2023-07-20 15:10:34,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-20 15:10:34,352 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-20 15:10:34,353 DEBUG [Listener at jenkins-hbase4.apache.org/33267] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-20 15:10:34,353 DEBUG [Listener at jenkins-hbase4.apache.org/33267] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-20 15:10:34,354 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-20 15:10:34,355 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-20 15:10:34,357 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 8 msec 2023-07-20 15:10:34,358 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-20 15:10:34,359 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689866434359 2023-07-20 15:10:34,382 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-07-20 15:10:34,382 INFO [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-07-20 15:10:34,382 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 15:10:34,384 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-07-20 15:10:34,384 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-20 15:10:34,384 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 15:10:34,384 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-20 15:10:34,386 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:10:34,386 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:10:34,386 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:10:34,386 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:10:34,387 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:10:34,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:10:34,387 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:10:34,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:10:34,387 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:10:34,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:10:34,387 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:10:34,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-20 15:10:34,387 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:10:34,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-20 15:10:34,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-20 15:10:34,388 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:10:34,388 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-20 15:10:34,388 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 15:10:34,388 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 15:10:34,388 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 15:10:34,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-20 15:10:34,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-20 15:10:34,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-20 15:10:34,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-20 15:10:34,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-20 15:10:34,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-20 15:10:34,389 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-20 15:10:34,389 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-20 15:10:34,389 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-20 15:10:34,389 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-20 15:10:34,389 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-20 15:10:34,390 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-20 15:10:34,390 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-20 15:10:34,390 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-20 15:10:34,389 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-20 15:10:34,390 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 15:10:34,390 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 15:10:34,390 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 15:10:34,393 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-20 15:10:34,394 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-20 15:10:34,394 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46155,1689865822636' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-20 15:10:34,391 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-20 15:10:34,394 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-20 15:10:34,394 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41343,1689865822688' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-20 15:10:34,394 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-20 15:10:34,395 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-20 15:10:34,395 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37315,1689865822568' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-20 15:10:34,398 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 15:10:34,398 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:10:34,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:10:34,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:10:34,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:10:34,398 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 15:10:34,399 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 15:10:34,399 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 15:10:34,399 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 15:10:34,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:10:34,399 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:10:34,399 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 15:10:34,400 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 15:10:34,400 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 15:10:34,400 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 15:10:34,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:10:34,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-20 15:10:34,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:10:34,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:10:34,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:10:34,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:10:34,402 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46155,1689865822636' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-20 15:10:34,402 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@493657bb[Count = 1] remaining members to acquire global barrier 2023-07-20 15:10:34,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:10:34,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:10:34,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:10:34,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:10:34,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:10:34,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-20 15:10:34,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:10:34,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:10:34,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:10:34,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:10:34,405 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37315,1689865822568' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-20 15:10:34,405 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@493657bb[Count = 0] remaining members to acquire global barrier 2023-07-20 15:10:34,405 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-20 15:10:34,405 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 15:10:34,411 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 15:10:34,411 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 15:10:34,411 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 15:10:34,411 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 15:10:34,411 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 15:10:34,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 15:10:34,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 15:10:34,411 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-20 15:10:34,412 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 15:10:34,412 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-20 15:10:34,411 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:10:34,412 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 15:10:34,412 DEBUG [rs(jenkins-hbase4.apache.org,37315,1689865822568)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689865831696.073d257db14973a57fbb43dbbac389c0. 2023-07-20 15:10:34,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 15:10:34,412 DEBUG [rs(jenkins-hbase4.apache.org,37315,1689865822568)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689865831696.073d257db14973a57fbb43dbbac389c0. started... 2023-07-20 15:10:34,412 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-20 15:10:34,412 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 15:10:34,412 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 15:10:34,412 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 15:10:34,412 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-20 15:10:34,412 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:10:34,412 INFO [rs(jenkins-hbase4.apache.org,37315,1689865822568)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 073d257db14973a57fbb43dbbac389c0 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-20 15:10:34,412 DEBUG [rs(jenkins-hbase4.apache.org,46155,1689865822636)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689865831696.291ff7a49a05762b225e6fe0f08cecf9. 2023-07-20 15:10:34,413 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-20 15:10:34,412 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,41343,1689865822688' in zk 2023-07-20 15:10:34,413 DEBUG [rs(jenkins-hbase4.apache.org,46155,1689865822636)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689865831696.291ff7a49a05762b225e6fe0f08cecf9. started... 2023-07-20 15:10:34,413 INFO [rs(jenkins-hbase4.apache.org,46155,1689865822636)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 291ff7a49a05762b225e6fe0f08cecf9 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-20 15:10:34,417 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-20 15:10:34,417 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 15:10:34,417 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-20 15:10:34,454 DEBUG [Listener at jenkins-hbase4.apache.org/33267] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 15:10:34,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-20 15:10:34,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-20 15:10:34,456 DEBUG [Listener at jenkins-hbase4.apache.org/33267] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-20 15:10:34,604 INFO [rs(jenkins-hbase4.apache.org,46155,1689865822636)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023072015ccb625f5464f12b78341f2117fcf31 to hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023072015ccb625f5464f12b78341f2117fcf31 2023-07-20 15:10:34,604 INFO [rs(jenkins-hbase4.apache.org,37315,1689865822568)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230720fd4b74454cd147b9b04ed7b7174c15fb to hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230720fd4b74454cd147b9b04ed7b7174c15fb 2023-07-20 15:10:34,650 INFO [rs(jenkins-hbase4.apache.org,46155,1689865822636)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportWithTargetName/291ff7a49a05762b225e6fe0f08cecf9/.tmp/cf/8ab27e954f6e489fa6251408213e468e 2023-07-20 15:10:34,652 INFO [rs(jenkins-hbase4.apache.org,37315,1689865822568)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportWithTargetName/073d257db14973a57fbb43dbbac389c0/.tmp/cf/85b665b3c5d3448ea58a876676602912 2023-07-20 15:10:34,656 DEBUG [Listener at jenkins-hbase4.apache.org/33267] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 15:10:34,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-20 15:10:34,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-20 15:10:34,658 DEBUG [Listener at jenkins-hbase4.apache.org/33267] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-20 15:10:34,668 DEBUG [rs(jenkins-hbase4.apache.org,46155,1689865822636)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportWithTargetName/291ff7a49a05762b225e6fe0f08cecf9/.tmp/cf/8ab27e954f6e489fa6251408213e468e as hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportWithTargetName/291ff7a49a05762b225e6fe0f08cecf9/cf/8ab27e954f6e489fa6251408213e468e 2023-07-20 15:10:34,668 DEBUG [rs(jenkins-hbase4.apache.org,37315,1689865822568)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportWithTargetName/073d257db14973a57fbb43dbbac389c0/.tmp/cf/85b665b3c5d3448ea58a876676602912 as hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportWithTargetName/073d257db14973a57fbb43dbbac389c0/cf/85b665b3c5d3448ea58a876676602912 2023-07-20 15:10:34,679 INFO [rs(jenkins-hbase4.apache.org,37315,1689865822568)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportWithTargetName/073d257db14973a57fbb43dbbac389c0/cf/85b665b3c5d3448ea58a876676602912, entries=4, sequenceid=6, filesize=5.6 K 2023-07-20 15:10:34,682 INFO [rs(jenkins-hbase4.apache.org,37315,1689865822568)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 073d257db14973a57fbb43dbbac389c0 in 270ms, sequenceid=6, compaction requested=false 2023-07-20 15:10:34,682 DEBUG [rs(jenkins-hbase4.apache.org,37315,1689865822568)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-20 15:10:34,683 DEBUG [rs(jenkins-hbase4.apache.org,37315,1689865822568)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 073d257db14973a57fbb43dbbac389c0: 2023-07-20 15:10:34,684 DEBUG [rs(jenkins-hbase4.apache.org,37315,1689865822568)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689865831696.073d257db14973a57fbb43dbbac389c0.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-20 15:10:34,684 DEBUG [rs(jenkins-hbase4.apache.org,37315,1689865822568)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 15:10:34,684 DEBUG [rs(jenkins-hbase4.apache.org,37315,1689865822568)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportWithTargetName/073d257db14973a57fbb43dbbac389c0/cf/85b665b3c5d3448ea58a876676602912] hfiles 2023-07-20 15:10:34,684 DEBUG [rs(jenkins-hbase4.apache.org,37315,1689865822568)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportWithTargetName/073d257db14973a57fbb43dbbac389c0/cf/85b665b3c5d3448ea58a876676602912 for snapshot=snaptb0-testExportWithTargetName 2023-07-20 15:10:34,685 INFO [rs(jenkins-hbase4.apache.org,46155,1689865822636)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportWithTargetName/291ff7a49a05762b225e6fe0f08cecf9/cf/8ab27e954f6e489fa6251408213e468e, entries=46, sequenceid=6, filesize=12.6 K 2023-07-20 15:10:34,688 INFO [rs(jenkins-hbase4.apache.org,46155,1689865822636)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 291ff7a49a05762b225e6fe0f08cecf9 in 275ms, sequenceid=6, compaction requested=false 2023-07-20 15:10:34,690 DEBUG [rs(jenkins-hbase4.apache.org,46155,1689865822636)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 291ff7a49a05762b225e6fe0f08cecf9: 2023-07-20 15:10:34,690 DEBUG [rs(jenkins-hbase4.apache.org,46155,1689865822636)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689865831696.291ff7a49a05762b225e6fe0f08cecf9.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-20 15:10:34,690 DEBUG [rs(jenkins-hbase4.apache.org,46155,1689865822636)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 15:10:34,690 DEBUG [rs(jenkins-hbase4.apache.org,46155,1689865822636)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportWithTargetName/291ff7a49a05762b225e6fe0f08cecf9/cf/8ab27e954f6e489fa6251408213e468e] hfiles 2023-07-20 15:10:34,690 DEBUG [rs(jenkins-hbase4.apache.org,46155,1689865822636)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportWithTargetName/291ff7a49a05762b225e6fe0f08cecf9/cf/8ab27e954f6e489fa6251408213e468e for snapshot=snaptb0-testExportWithTargetName 2023-07-20 15:10:34,722 DEBUG [rs(jenkins-hbase4.apache.org,46155,1689865822636)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689865831696.291ff7a49a05762b225e6fe0f08cecf9. completed. 2023-07-20 15:10:34,722 DEBUG [rs(jenkins-hbase4.apache.org,46155,1689865822636)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689865831696.291ff7a49a05762b225e6fe0f08cecf9. 2023-07-20 15:10:34,722 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 15:10:34,722 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 15:10:34,722 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:10:34,722 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-20 15:10:34,722 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,46155,1689865822636' in zk 2023-07-20 15:10:34,723 DEBUG [rs(jenkins-hbase4.apache.org,37315,1689865822568)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689865831696.073d257db14973a57fbb43dbbac389c0. completed. 2023-07-20 15:10:34,723 DEBUG [rs(jenkins-hbase4.apache.org,37315,1689865822568)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689865831696.073d257db14973a57fbb43dbbac389c0. 2023-07-20 15:10:34,723 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 15:10:34,723 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 15:10:34,723 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:10:34,723 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-20 15:10:34,723 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,37315,1689865822568' in zk 2023-07-20 15:10:34,724 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-20 15:10:34,724 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:10:34,725 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 15:10:34,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:10:34,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:10:34,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:10:34,725 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-20 15:10:34,727 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:10:34,727 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-20 15:10:34,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:10:34,727 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 15:10:34,727 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-20 15:10:34,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:10:34,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-20 15:10:34,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:10:34,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:10:34,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:10:34,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:10:34,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-20 15:10:34,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:10:34,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:10:34,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:10:34,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,46155,1689865822636': 2023-07-20 15:10:34,736 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46155,1689865822636' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-20 15:10:34,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:10:34,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:10:34,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:10:34,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:10:34,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:10:34,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-20 15:10:34,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:10:34,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:10:34,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:10:34,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:10:34,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-20 15:10:34,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:10:34,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:10:34,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:10:34,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,37315,1689865822568': 2023-07-20 15:10:34,741 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37315,1689865822568' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-20 15:10:34,741 INFO [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-07-20 15:10:34,742 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-20 15:10:34,742 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-20 15:10:34,742 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-07-20 15:10:34,742 INFO [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-20 15:10:34,745 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 15:10:34,745 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 15:10:34,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 15:10:34,745 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 15:10:34,745 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 15:10:34,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 15:10:34,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:10:34,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:10:34,745 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:10:34,745 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 15:10:34,745 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 15:10:34,745 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:10:34,745 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:10:34,745 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:10:34,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:10:34,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 15:10:34,745 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 15:10:34,745 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:10:34,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 15:10:34,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:10:34,746 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:10:34,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-20 15:10:34,746 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:10:34,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:10:34,746 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:10:34,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:10:34,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 15:10:34,746 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:10:34,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 15:10:34,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:10:34,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-20 15:10:34,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 15:10:34,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:10:34,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:10:34,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:10:34,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:10:34,749 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:10:34,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-20 15:10:34,749 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:10:34,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:10:34,753 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:10:34,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:10:34,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:10:34,765 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:10:34,765 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:10:34,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:10:34,765 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:10:34,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:10:34,765 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:10:34,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:10:34,765 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:10:34,765 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 15:10:34,765 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-20 15:10:34,765 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:10:34,765 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-07-20 15:10:34,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:10:34,766 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:10:34,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:10:34,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:10:34,765 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-07-20 15:10:34,765 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:10:34,765 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:10:34,766 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-20 15:10:34,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:10:34,766 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-20 15:10:34,767 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:10:34,766 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:10:34,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:10:34,767 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-20 15:10:34,767 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:10:34,767 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 15:10:34,767 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:10:34,767 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:10:34,767 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:10:34,767 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 15:10:34,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:10:34,767 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 15:10:34,768 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023072015ccb625f5464f12b78341f2117fcf31, hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230720fd4b74454cd147b9b04ed7b7174c15fb] mob files 2023-07-20 15:10:34,768 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023072015ccb625f5464f12b78341f2117fcf31 2023-07-20 15:10:34,768 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230720fd4b74454cd147b9b04ed7b7174c15fb 2023-07-20 15:10:34,791 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-07-20 15:10:34,792 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-20 15:10:34,845 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-20 15:10:34,928 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-20 15:10:34,928 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-20 15:10:34,928 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-20 15:10:34,928 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689865834352Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1689865834791 (+439 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1689865834791Loading Region manifests for snaptb0-testExportWithTargetName at 1689865834791Writing data manifest for snaptb0-testExportWithTargetName at 1689865834797 (+6 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1689865834819 (+22 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689865834928 (+109 ms) 2023-07-20 15:10:34,930 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-20 15:10:34,934 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 578 msec 2023-07-20 15:10:34,959 DEBUG [Listener at jenkins-hbase4.apache.org/33267] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 15:10:34,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-20 15:10:34,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-20 15:10:34,962 INFO [Listener at jenkins-hbase4.apache.org/33267] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/export-test/export-1689865834962 2023-07-20 15:10:34,963 INFO [Listener at jenkins-hbase4.apache.org/33267] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:42063, tgtDir=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/export-test/export-1689865834962, rawTgtDir=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/export-test/export-1689865834962, srcFsUri=hdfs://localhost:42063, srcDir=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b 2023-07-20 15:10:35,009 DEBUG [Listener at jenkins-hbase4.apache.org/33267] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:42063, inputRoot=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b 2023-07-20 15:10:35,010 DEBUG [Listener at jenkins-hbase4.apache.org/33267] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1703043309_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/export-test/export-1689865834962, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/export-test/export-1689865834962/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-20 15:10:35,010 INFO [Listener at jenkins-hbase4.apache.org/33267] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:42063, inputRoot=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b, snapshotDir=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-07-20 15:10:35,036 INFO [Listener at jenkins-hbase4.apache.org/33267] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/export-test/export-1689865834962/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-20 15:10:35,138 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-20 15:10:35,139 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-20 15:10:35,140 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-20 15:10:35,140 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-20 15:10:35,141 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-20 15:10:35,141 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-20 15:10:35,142 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-20 15:10:35,224 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a3c136b5-559e-274b-8286-a02c66f74c8f/hadoop-951936894206948377.jar 2023-07-20 15:10:35,224 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-20 15:10:35,225 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-20 15:10:35,225 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-20 15:10:35,226 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-20 15:10:35,227 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-20 15:10:35,227 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-20 15:10:35,228 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-20 15:10:35,228 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-20 15:10:35,229 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-20 15:10:35,229 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-20 15:10:35,229 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-20 15:10:35,230 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-20 15:10:35,230 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-20 15:10:35,231 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-20 15:10:35,231 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-20 15:10:35,232 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-20 15:10:35,235 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 15:10:35,235 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 15:10:35,235 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 15:10:35,236 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 15:10:35,236 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 15:10:35,236 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 15:10:35,237 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 15:10:36,205 WARN [Listener at jenkins-hbase4.apache.org/33267] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-20 15:10:36,212 INFO [Listener at jenkins-hbase4.apache.org/33267] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-07-20 15:10:36,222 DEBUG [Listener at jenkins-hbase4.apache.org/33267] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-07-20 15:10:36,833 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-20 15:10:36,835 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-20 15:10:37,266 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689865830265_0001_000001 (auth:SIMPLE) 2023-07-20 15:10:37,779 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-20 15:10:42,590 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689865830265_0001_000001 (auth:SIMPLE) 2023-07-20 15:10:44,866 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689865830265_0001_000001 (auth:SIMPLE) 2023-07-20 15:10:48,199 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689865830265_0001_000001 (auth:SIMPLE) 2023-07-20 15:10:50,261 INFO [Listener at jenkins-hbase4.apache.org/33267] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-20 15:10:50,263 INFO [Listener at jenkins-hbase4.apache.org/33267] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-20 15:10:50,276 INFO [Listener at jenkins-hbase4.apache.org/33267] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-07-20 15:10:50,277 INFO [Listener at jenkins-hbase4.apache.org/33267] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-20 15:10:50,277 INFO [Listener at jenkins-hbase4.apache.org/33267] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-20 15:10:50,277 DEBUG [Listener at jenkins-hbase4.apache.org/33267] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_478830040_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-20 15:10:50,278 DEBUG [Listener at jenkins-hbase4.apache.org/33267] snapshot.TestExportSnapshot(367): hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-07-20 15:10:50,278 DEBUG [Listener at jenkins-hbase4.apache.org/33267] snapshot.TestExportSnapshot(367): hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-07-20 15:10:50,278 DEBUG [Listener at jenkins-hbase4.apache.org/33267] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_478830040_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/export-test/export-1689865834962/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/export-test/export-1689865834962/.hbase-snapshot/testExportWithTargetName 2023-07-20 15:10:50,279 DEBUG [Listener at jenkins-hbase4.apache.org/33267] snapshot.TestExportSnapshot(367): hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/export-test/export-1689865834962/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-07-20 15:10:50,279 DEBUG [Listener at jenkins-hbase4.apache.org/33267] snapshot.TestExportSnapshot(367): hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/export-test/export-1689865834962/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-07-20 15:10:50,290 INFO [Listener at jenkins-hbase4.apache.org/33267] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-07-20 15:10:50,295 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-07-20 15:10:50,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-07-20 15:10:50,308 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689865850307"}]},"ts":"1689865850307"} 2023-07-20 15:10:50,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-20 15:10:50,310 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-07-20 15:10:50,311 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-07-20 15:10:50,313 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=073d257db14973a57fbb43dbbac389c0, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=291ff7a49a05762b225e6fe0f08cecf9, UNASSIGN}] 2023-07-20 15:10:50,316 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=073d257db14973a57fbb43dbbac389c0, UNASSIGN 2023-07-20 15:10:50,316 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=291ff7a49a05762b225e6fe0f08cecf9, UNASSIGN 2023-07-20 15:10:50,317 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=073d257db14973a57fbb43dbbac389c0, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:10:50,317 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=291ff7a49a05762b225e6fe0f08cecf9, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:10:50,317 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689865831696.073d257db14973a57fbb43dbbac389c0.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689865850317"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689865850317"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689865850317"}]},"ts":"1689865850317"} 2023-07-20 15:10:50,317 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689865831696.291ff7a49a05762b225e6fe0f08cecf9.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689865850317"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689865850317"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689865850317"}]},"ts":"1689865850317"} 2023-07-20 15:10:50,319 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=22, state=RUNNABLE; CloseRegionProcedure 073d257db14973a57fbb43dbbac389c0, server=jenkins-hbase4.apache.org,37315,1689865822568}] 2023-07-20 15:10:50,320 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; CloseRegionProcedure 291ff7a49a05762b225e6fe0f08cecf9, server=jenkins-hbase4.apache.org,46155,1689865822636}] 2023-07-20 15:10:50,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-20 15:10:50,480 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 073d257db14973a57fbb43dbbac389c0 2023-07-20 15:10:50,480 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 291ff7a49a05762b225e6fe0f08cecf9 2023-07-20 15:10:50,480 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 073d257db14973a57fbb43dbbac389c0, disabling compactions & flushes 2023-07-20 15:10:50,480 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 291ff7a49a05762b225e6fe0f08cecf9, disabling compactions & flushes 2023-07-20 15:10:50,480 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689865831696.073d257db14973a57fbb43dbbac389c0. 2023-07-20 15:10:50,480 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689865831696.291ff7a49a05762b225e6fe0f08cecf9. 2023-07-20 15:10:50,480 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689865831696.073d257db14973a57fbb43dbbac389c0. 2023-07-20 15:10:50,480 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689865831696.291ff7a49a05762b225e6fe0f08cecf9. 2023-07-20 15:10:50,480 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689865831696.073d257db14973a57fbb43dbbac389c0. after waiting 0 ms 2023-07-20 15:10:50,480 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689865831696.073d257db14973a57fbb43dbbac389c0. 2023-07-20 15:10:50,480 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689865831696.291ff7a49a05762b225e6fe0f08cecf9. after waiting 0 ms 2023-07-20 15:10:50,480 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689865831696.291ff7a49a05762b225e6fe0f08cecf9. 2023-07-20 15:10:50,495 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportWithTargetName/073d257db14973a57fbb43dbbac389c0/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-20 15:10:50,495 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportWithTargetName/291ff7a49a05762b225e6fe0f08cecf9/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-20 15:10:50,496 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 15:10:50,496 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 15:10:50,498 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689865831696.291ff7a49a05762b225e6fe0f08cecf9. 2023-07-20 15:10:50,498 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689865831696.073d257db14973a57fbb43dbbac389c0. 2023-07-20 15:10:50,498 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 291ff7a49a05762b225e6fe0f08cecf9: 2023-07-20 15:10:50,498 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 073d257db14973a57fbb43dbbac389c0: 2023-07-20 15:10:50,500 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 073d257db14973a57fbb43dbbac389c0 2023-07-20 15:10:50,501 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=073d257db14973a57fbb43dbbac389c0, regionState=CLOSED 2023-07-20 15:10:50,501 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 291ff7a49a05762b225e6fe0f08cecf9 2023-07-20 15:10:50,501 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689865831696.073d257db14973a57fbb43dbbac389c0.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689865850501"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689865850501"}]},"ts":"1689865850501"} 2023-07-20 15:10:50,502 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=291ff7a49a05762b225e6fe0f08cecf9, regionState=CLOSED 2023-07-20 15:10:50,502 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689865831696.291ff7a49a05762b225e6fe0f08cecf9.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689865850502"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689865850502"}]},"ts":"1689865850502"} 2023-07-20 15:10:50,506 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=22 2023-07-20 15:10:50,506 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=22, state=SUCCESS; CloseRegionProcedure 073d257db14973a57fbb43dbbac389c0, server=jenkins-hbase4.apache.org,37315,1689865822568 in 184 msec 2023-07-20 15:10:50,507 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=23 2023-07-20 15:10:50,507 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=23, state=SUCCESS; CloseRegionProcedure 291ff7a49a05762b225e6fe0f08cecf9, server=jenkins-hbase4.apache.org,46155,1689865822636 in 184 msec 2023-07-20 15:10:50,508 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=073d257db14973a57fbb43dbbac389c0, UNASSIGN in 193 msec 2023-07-20 15:10:50,509 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=21 2023-07-20 15:10:50,509 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=291ff7a49a05762b225e6fe0f08cecf9, UNASSIGN in 194 msec 2023-07-20 15:10:50,510 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689865850510"}]},"ts":"1689865850510"} 2023-07-20 15:10:50,512 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-07-20 15:10:50,514 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-07-20 15:10:50,518 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 217 msec 2023-07-20 15:10:50,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-20 15:10:50,612 INFO [Listener at jenkins-hbase4.apache.org/33267] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-07-20 15:10:50,619 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-07-20 15:10:50,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-20 15:10:50,629 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-20 15:10:50,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-07-20 15:10:50,631 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-20 15:10:50,635 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41343] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-07-20 15:10:50,637 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testExportWithTargetName/073d257db14973a57fbb43dbbac389c0 2023-07-20 15:10:50,637 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testExportWithTargetName/291ff7a49a05762b225e6fe0f08cecf9 2023-07-20 15:10:50,639 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-20 15:10:50,639 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-20 15:10:50,639 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-20 15:10:50,639 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-20 15:10:50,639 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-20 15:10:50,639 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-20 15:10:50,640 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-20 15:10:50,640 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-20 15:10:50,640 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-20 15:10:50,640 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-20 15:10:50,640 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 15:10:50,640 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-20 15:10:50,640 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-20 15:10:50,641 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 15:10:50,640 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 15:10:50,641 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 15:10:50,641 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testExportWithTargetName/073d257db14973a57fbb43dbbac389c0/cf, FileablePath, hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testExportWithTargetName/073d257db14973a57fbb43dbbac389c0/recovered.edits] 2023-07-20 15:10:50,641 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testExportWithTargetName/291ff7a49a05762b225e6fe0f08cecf9/cf, FileablePath, hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testExportWithTargetName/291ff7a49a05762b225e6fe0f08cecf9/recovered.edits] 2023-07-20 15:10:50,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-20 15:10:50,650 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testExportWithTargetName/291ff7a49a05762b225e6fe0f08cecf9/cf/8ab27e954f6e489fa6251408213e468e to hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/archive/data/default/testtb-testExportWithTargetName/291ff7a49a05762b225e6fe0f08cecf9/cf/8ab27e954f6e489fa6251408213e468e 2023-07-20 15:10:50,650 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testExportWithTargetName/073d257db14973a57fbb43dbbac389c0/cf/85b665b3c5d3448ea58a876676602912 to hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/archive/data/default/testtb-testExportWithTargetName/073d257db14973a57fbb43dbbac389c0/cf/85b665b3c5d3448ea58a876676602912 2023-07-20 15:10:50,655 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testExportWithTargetName/291ff7a49a05762b225e6fe0f08cecf9/recovered.edits/9.seqid to hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/archive/data/default/testtb-testExportWithTargetName/291ff7a49a05762b225e6fe0f08cecf9/recovered.edits/9.seqid 2023-07-20 15:10:50,655 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testExportWithTargetName/073d257db14973a57fbb43dbbac389c0/recovered.edits/9.seqid to hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/archive/data/default/testtb-testExportWithTargetName/073d257db14973a57fbb43dbbac389c0/recovered.edits/9.seqid 2023-07-20 15:10:50,656 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testExportWithTargetName/291ff7a49a05762b225e6fe0f08cecf9 2023-07-20 15:10:50,656 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testExportWithTargetName/073d257db14973a57fbb43dbbac389c0 2023-07-20 15:10:50,656 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-20 15:10:50,656 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-07-20 15:10:50,657 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-07-20 15:10:50,662 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023072015ccb625f5464f12b78341f2117fcf31 to hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023072015ccb625f5464f12b78341f2117fcf31 2023-07-20 15:10:50,663 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230720fd4b74454cd147b9b04ed7b7174c15fb to hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230720fd4b74454cd147b9b04ed7b7174c15fb 2023-07-20 15:10:50,664 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-07-20 15:10:50,667 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-20 15:10:50,688 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-07-20 15:10:50,691 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-07-20 15:10:50,693 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-20 15:10:50,693 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-07-20 15:10:50,693 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1689865831696.073d257db14973a57fbb43dbbac389c0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689865850693"}]},"ts":"9223372036854775807"} 2023-07-20 15:10:50,694 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1689865831696.291ff7a49a05762b225e6fe0f08cecf9.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689865850693"}]},"ts":"9223372036854775807"} 2023-07-20 15:10:50,696 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-20 15:10:50,696 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 073d257db14973a57fbb43dbbac389c0, NAME => 'testtb-testExportWithTargetName,,1689865831696.073d257db14973a57fbb43dbbac389c0.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 291ff7a49a05762b225e6fe0f08cecf9, NAME => 'testtb-testExportWithTargetName,1,1689865831696.291ff7a49a05762b225e6fe0f08cecf9.', STARTKEY => '1', ENDKEY => ''}] 2023-07-20 15:10:50,696 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-07-20 15:10:50,696 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689865850696"}]},"ts":"9223372036854775807"} 2023-07-20 15:10:50,699 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-07-20 15:10:50,701 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-20 15:10:50,702 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 81 msec 2023-07-20 15:10:50,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-20 15:10:50,747 INFO [Listener at jenkins-hbase4.apache.org/33267] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-07-20 15:10:50,766 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-07-20 15:10:50,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:50,772 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-07-20 15:10:50,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-07-20 15:10:50,817 INFO [Listener at jenkins-hbase4.apache.org/33267] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=750 (was 704) Potentially hanging thread: Thread-1316 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3c085ba2-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3c085ba2-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a3c136b5-559e-274b-8286-a02c66f74c8f/cluster_7c972e76-1c0e-2046-c767-99afc843fe90/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a3c136b5-559e-274b-8286-a02c66f74c8f/cluster_7c972e76-1c0e-2046-c767-99afc843fe90/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1484284473) connection to jenkins-hbase4.apache.org/172.31.14.131:44629 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a3c136b5-559e-274b-8286-a02c66f74c8f/cluster_7c972e76-1c0e-2046-c767-99afc843fe90/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_478830040_17 at /127.0.0.1:45792 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1484284473) connection to jenkins-hbase4.apache.org/172.31.14.131:36399 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_478830040_17 at /127.0.0.1:48664 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_478830040_17 at /127.0.0.1:35664 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3c085ba2-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a3c136b5-559e-274b-8286-a02c66f74c8f/cluster_7c972e76-1c0e-2046-c767-99afc843fe90/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1941457125_1 at /127.0.0.1:35638 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a3c136b5-559e-274b-8286-a02c66f74c8f/cluster_7c972e76-1c0e-2046-c767-99afc843fe90/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3c085ba2-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a3c136b5-559e-274b-8286-a02c66f74c8f/cluster_7c972e76-1c0e-2046-c767-99afc843fe90/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=920 (was 906) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=324 (was 265) - SystemLoadAverage LEAK? -, ProcessCount=183 (was 177) - ProcessCount LEAK? -, AvailableMemoryMB=3436 (was 5252) 2023-07-20 15:10:50,817 WARN [Listener at jenkins-hbase4.apache.org/33267] hbase.ResourceChecker(130): Thread=750 is superior to 500 2023-07-20 15:10:50,843 INFO [Listener at jenkins-hbase4.apache.org/33267] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=750, OpenFileDescriptor=920, MaxFileDescriptor=60000, SystemLoadAverage=324, ProcessCount=183, AvailableMemoryMB=3434 2023-07-20 15:10:50,843 WARN [Listener at jenkins-hbase4.apache.org/33267] hbase.ResourceChecker(130): Thread=750 is superior to 500 2023-07-20 15:10:50,845 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-20 15:10:50,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-07-20 15:10:50,850 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-20 15:10:50,851 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-07-20 15:10:50,852 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-20 15:10:50,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-20 15:10:50,855 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testExportFileSystemState/6aa8e86dde429a3305ec424a45815a47 2023-07-20 15:10:50,855 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testExportFileSystemState/91b8c368f83d8f27c1299205661af241 2023-07-20 15:10:50,856 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testExportFileSystemState/6aa8e86dde429a3305ec424a45815a47 empty. 2023-07-20 15:10:50,856 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testExportFileSystemState/91b8c368f83d8f27c1299205661af241 empty. 2023-07-20 15:10:50,857 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testExportFileSystemState/91b8c368f83d8f27c1299205661af241 2023-07-20 15:10:50,857 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testExportFileSystemState/6aa8e86dde429a3305ec424a45815a47 2023-07-20 15:10:50,857 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-20 15:10:50,873 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-20 15:10:50,875 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 6aa8e86dde429a3305ec424a45815a47, NAME => 'testtb-testExportFileSystemState,,1689865850845.6aa8e86dde429a3305ec424a45815a47.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp 2023-07-20 15:10:50,879 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 91b8c368f83d8f27c1299205661af241, NAME => 'testtb-testExportFileSystemState,1,1689865850845.91b8c368f83d8f27c1299205661af241.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp 2023-07-20 15:10:50,909 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689865850845.91b8c368f83d8f27c1299205661af241.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 15:10:50,909 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 91b8c368f83d8f27c1299205661af241, disabling compactions & flushes 2023-07-20 15:10:50,909 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689865850845.91b8c368f83d8f27c1299205661af241. 2023-07-20 15:10:50,909 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689865850845.91b8c368f83d8f27c1299205661af241. 2023-07-20 15:10:50,909 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689865850845.91b8c368f83d8f27c1299205661af241. after waiting 0 ms 2023-07-20 15:10:50,909 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689865850845.91b8c368f83d8f27c1299205661af241. 2023-07-20 15:10:50,909 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689865850845.91b8c368f83d8f27c1299205661af241. 2023-07-20 15:10:50,909 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 91b8c368f83d8f27c1299205661af241: 2023-07-20 15:10:50,921 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689865850845.6aa8e86dde429a3305ec424a45815a47.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 15:10:50,922 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 6aa8e86dde429a3305ec424a45815a47, disabling compactions & flushes 2023-07-20 15:10:50,922 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689865850845.6aa8e86dde429a3305ec424a45815a47. 2023-07-20 15:10:50,922 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689865850845.6aa8e86dde429a3305ec424a45815a47. 2023-07-20 15:10:50,922 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689865850845.6aa8e86dde429a3305ec424a45815a47. after waiting 0 ms 2023-07-20 15:10:50,923 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689865850845.6aa8e86dde429a3305ec424a45815a47. 2023-07-20 15:10:50,923 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689865850845.6aa8e86dde429a3305ec424a45815a47. 2023-07-20 15:10:50,923 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 6aa8e86dde429a3305ec424a45815a47: 2023-07-20 15:10:50,933 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-20 15:10:50,934 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689865850845.91b8c368f83d8f27c1299205661af241.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689865850934"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689865850934"}]},"ts":"1689865850934"} 2023-07-20 15:10:50,935 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689865850845.6aa8e86dde429a3305ec424a45815a47.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689865850934"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689865850934"}]},"ts":"1689865850934"} 2023-07-20 15:10:50,937 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-20 15:10:50,939 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-20 15:10:50,939 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689865850939"}]},"ts":"1689865850939"} 2023-07-20 15:10:50,941 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-07-20 15:10:50,945 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-20 15:10:50,946 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-20 15:10:50,946 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-20 15:10:50,946 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-20 15:10:50,946 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-20 15:10:50,947 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6aa8e86dde429a3305ec424a45815a47, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=91b8c368f83d8f27c1299205661af241, ASSIGN}] 2023-07-20 15:10:50,949 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=91b8c368f83d8f27c1299205661af241, ASSIGN 2023-07-20 15:10:50,950 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6aa8e86dde429a3305ec424a45815a47, ASSIGN 2023-07-20 15:10:50,951 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=91b8c368f83d8f27c1299205661af241, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37315,1689865822568; forceNewPlan=false, retain=false 2023-07-20 15:10:50,951 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6aa8e86dde429a3305ec424a45815a47, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41343,1689865822688; forceNewPlan=false, retain=false 2023-07-20 15:10:50,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-20 15:10:51,101 INFO [jenkins-hbase4:38949] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-20 15:10:51,104 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=6aa8e86dde429a3305ec424a45815a47, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:10:51,104 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=91b8c368f83d8f27c1299205661af241, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:10:51,104 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689865850845.6aa8e86dde429a3305ec424a45815a47.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689865851104"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689865851104"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689865851104"}]},"ts":"1689865851104"} 2023-07-20 15:10:51,104 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689865850845.91b8c368f83d8f27c1299205661af241.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689865851104"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689865851104"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689865851104"}]},"ts":"1689865851104"} 2023-07-20 15:10:51,107 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=28, state=RUNNABLE; OpenRegionProcedure 6aa8e86dde429a3305ec424a45815a47, server=jenkins-hbase4.apache.org,41343,1689865822688}] 2023-07-20 15:10:51,108 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=29, state=RUNNABLE; OpenRegionProcedure 91b8c368f83d8f27c1299205661af241, server=jenkins-hbase4.apache.org,37315,1689865822568}] 2023-07-20 15:10:51,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-20 15:10:51,270 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1689865850845.91b8c368f83d8f27c1299205661af241. 2023-07-20 15:10:51,270 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 91b8c368f83d8f27c1299205661af241, NAME => 'testtb-testExportFileSystemState,1,1689865850845.91b8c368f83d8f27c1299205661af241.', STARTKEY => '1', ENDKEY => ''} 2023-07-20 15:10:51,271 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1689865850845.91b8c368f83d8f27c1299205661af241. service=AccessControlService 2023-07-20 15:10:51,271 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 15:10:51,271 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 91b8c368f83d8f27c1299205661af241 2023-07-20 15:10:51,271 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689865850845.91b8c368f83d8f27c1299205661af241.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 15:10:51,271 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 91b8c368f83d8f27c1299205661af241 2023-07-20 15:10:51,271 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 91b8c368f83d8f27c1299205661af241 2023-07-20 15:10:51,275 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1689865850845.6aa8e86dde429a3305ec424a45815a47. 2023-07-20 15:10:51,275 INFO [StoreOpener-91b8c368f83d8f27c1299205661af241-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 91b8c368f83d8f27c1299205661af241 2023-07-20 15:10:51,275 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6aa8e86dde429a3305ec424a45815a47, NAME => 'testtb-testExportFileSystemState,,1689865850845.6aa8e86dde429a3305ec424a45815a47.', STARTKEY => '', ENDKEY => '1'} 2023-07-20 15:10:51,276 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1689865850845.6aa8e86dde429a3305ec424a45815a47. service=AccessControlService 2023-07-20 15:10:51,276 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 15:10:51,276 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 6aa8e86dde429a3305ec424a45815a47 2023-07-20 15:10:51,276 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689865850845.6aa8e86dde429a3305ec424a45815a47.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 15:10:51,276 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6aa8e86dde429a3305ec424a45815a47 2023-07-20 15:10:51,276 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6aa8e86dde429a3305ec424a45815a47 2023-07-20 15:10:51,276 DEBUG [StoreOpener-91b8c368f83d8f27c1299205661af241-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportFileSystemState/91b8c368f83d8f27c1299205661af241/cf 2023-07-20 15:10:51,277 DEBUG [StoreOpener-91b8c368f83d8f27c1299205661af241-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportFileSystemState/91b8c368f83d8f27c1299205661af241/cf 2023-07-20 15:10:51,277 INFO [StoreOpener-91b8c368f83d8f27c1299205661af241-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 91b8c368f83d8f27c1299205661af241 columnFamilyName cf 2023-07-20 15:10:51,278 INFO [StoreOpener-6aa8e86dde429a3305ec424a45815a47-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 6aa8e86dde429a3305ec424a45815a47 2023-07-20 15:10:51,279 INFO [StoreOpener-91b8c368f83d8f27c1299205661af241-1] regionserver.HStore(310): Store=91b8c368f83d8f27c1299205661af241/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 15:10:51,281 DEBUG [StoreOpener-6aa8e86dde429a3305ec424a45815a47-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportFileSystemState/6aa8e86dde429a3305ec424a45815a47/cf 2023-07-20 15:10:51,281 DEBUG [StoreOpener-6aa8e86dde429a3305ec424a45815a47-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportFileSystemState/6aa8e86dde429a3305ec424a45815a47/cf 2023-07-20 15:10:51,282 INFO [StoreOpener-6aa8e86dde429a3305ec424a45815a47-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6aa8e86dde429a3305ec424a45815a47 columnFamilyName cf 2023-07-20 15:10:51,282 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportFileSystemState/91b8c368f83d8f27c1299205661af241 2023-07-20 15:10:51,283 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportFileSystemState/91b8c368f83d8f27c1299205661af241 2023-07-20 15:10:51,283 INFO [StoreOpener-6aa8e86dde429a3305ec424a45815a47-1] regionserver.HStore(310): Store=6aa8e86dde429a3305ec424a45815a47/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 15:10:51,287 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportFileSystemState/6aa8e86dde429a3305ec424a45815a47 2023-07-20 15:10:51,287 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 91b8c368f83d8f27c1299205661af241 2023-07-20 15:10:51,287 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportFileSystemState/6aa8e86dde429a3305ec424a45815a47 2023-07-20 15:10:51,292 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportFileSystemState/91b8c368f83d8f27c1299205661af241/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 15:10:51,293 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 91b8c368f83d8f27c1299205661af241; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59522059, jitterRate=-0.11305220425128937}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 15:10:51,293 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 91b8c368f83d8f27c1299205661af241: 2023-07-20 15:10:51,294 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6aa8e86dde429a3305ec424a45815a47 2023-07-20 15:10:51,295 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1689865850845.91b8c368f83d8f27c1299205661af241., pid=31, masterSystemTime=1689865851261 2023-07-20 15:10:51,297 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1689865850845.91b8c368f83d8f27c1299205661af241. 2023-07-20 15:10:51,297 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1689865850845.91b8c368f83d8f27c1299205661af241. 2023-07-20 15:10:51,297 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=91b8c368f83d8f27c1299205661af241, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:10:51,298 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1689865850845.91b8c368f83d8f27c1299205661af241.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689865851297"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689865851297"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689865851297"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689865851297"}]},"ts":"1689865851297"} 2023-07-20 15:10:51,299 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportFileSystemState/6aa8e86dde429a3305ec424a45815a47/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 15:10:51,300 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6aa8e86dde429a3305ec424a45815a47; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70355336, jitterRate=0.04837620258331299}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 15:10:51,300 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6aa8e86dde429a3305ec424a45815a47: 2023-07-20 15:10:51,301 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1689865850845.6aa8e86dde429a3305ec424a45815a47., pid=30, masterSystemTime=1689865851261 2023-07-20 15:10:51,303 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1689865850845.6aa8e86dde429a3305ec424a45815a47. 2023-07-20 15:10:51,303 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1689865850845.6aa8e86dde429a3305ec424a45815a47. 2023-07-20 15:10:51,303 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=29 2023-07-20 15:10:51,305 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=29, state=SUCCESS; OpenRegionProcedure 91b8c368f83d8f27c1299205661af241, server=jenkins-hbase4.apache.org,37315,1689865822568 in 192 msec 2023-07-20 15:10:51,305 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=6aa8e86dde429a3305ec424a45815a47, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:10:51,306 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1689865850845.6aa8e86dde429a3305ec424a45815a47.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689865851305"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689865851305"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689865851305"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689865851305"}]},"ts":"1689865851305"} 2023-07-20 15:10:51,307 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=91b8c368f83d8f27c1299205661af241, ASSIGN in 358 msec 2023-07-20 15:10:51,311 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=28 2023-07-20 15:10:51,315 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=28, state=SUCCESS; OpenRegionProcedure 6aa8e86dde429a3305ec424a45815a47, server=jenkins-hbase4.apache.org,41343,1689865822688 in 201 msec 2023-07-20 15:10:51,318 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=27 2023-07-20 15:10:51,318 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6aa8e86dde429a3305ec424a45815a47, ASSIGN in 369 msec 2023-07-20 15:10:51,319 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-20 15:10:51,319 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689865851319"}]},"ts":"1689865851319"} 2023-07-20 15:10:51,321 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-07-20 15:10:51,324 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-20 15:10:51,325 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-07-20 15:10:51,327 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41343] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-20 15:10:51,329 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 15:10:51,329 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 15:10:51,329 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 15:10:51,329 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 15:10:51,331 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-20 15:10:51,332 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-20 15:10:51,332 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-20 15:10:51,332 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-20 15:10:51,335 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 485 msec 2023-07-20 15:10:51,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-20 15:10:51,457 INFO [Listener at jenkins-hbase4.apache.org/33267] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-07-20 15:10:51,461 DEBUG [Listener at jenkins-hbase4.apache.org/33267] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-20 15:10:51,462 DEBUG [Listener at jenkins-hbase4.apache.org/33267] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689865850845.6aa8e86dde429a3305ec424a45815a47. 2023-07-20 15:10:51,465 INFO [Listener at jenkins-hbase4.apache.org/33267] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-20 15:10:51,489 DEBUG [hconnection-0x30531378-shared-pool-10] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 15:10:51,502 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55636, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 15:10:51,510 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-20 15:10:51,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689865851510 (current time:1689865851510). 2023-07-20 15:10:51,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-20 15:10:51,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] zookeeper.ReadOnlyZKClient(139): Connect 0x04ef6cab to 127.0.0.1:64446 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 15:10:51,526 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@41318918, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 15:10:51,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 15:10:51,528 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47106, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 15:10:51,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x04ef6cab to 127.0.0.1:64446 2023-07-20 15:10:51,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 15:10:51,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] zookeeper.ReadOnlyZKClient(139): Connect 0x67a5fb46 to 127.0.0.1:64446 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 15:10:51,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1850592d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 15:10:51,540 DEBUG [hconnection-0x55e47a76-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 15:10:51,543 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47110, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 15:10:51,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 15:10:51,549 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55642, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 15:10:51,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x67a5fb46 to 127.0.0.1:64446 2023-07-20 15:10:51,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 15:10:51,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-20 15:10:51,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-20 15:10:51,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-20 15:10:51,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-20 15:10:51,557 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-20 15:10:51,558 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689866451558 2023-07-20 15:10:51,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-20 15:10:51,558 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-20 15:10:51,563 DEBUG [Listener at jenkins-hbase4.apache.org/33267] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-20 15:10:51,563 DEBUG [Listener at jenkins-hbase4.apache.org/33267] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-20 15:10:51,563 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-20 15:10:51,564 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-20 15:10:51,566 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 10 msec 2023-07-20 15:10:51,567 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-20 15:10:51,568 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689866451568 2023-07-20 15:10:51,586 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:51,586 INFO [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-07-20 15:10:51,586 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 15:10:51,588 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-07-20 15:10:51,588 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-20 15:10:51,654 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:51,654 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:51,655 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:10:51,655 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:10:51,656 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:10:51,656 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:10:51,656 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:10:51,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:10:51,655 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:10:51,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:10:51,656 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:10:51,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:10:51,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:51,656 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:10:51,657 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:10:51,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:51,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:51,657 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:51,657 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:51,657 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:10:51,657 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-20 15:10:51,657 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:51,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-20 15:10:51,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:51,658 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-20 15:10:51,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-20 15:10:51,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:51,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-20 15:10:51,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:51,658 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-20 15:10:51,658 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-20 15:10:51,659 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:51,659 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:51,659 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:51,659 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-20 15:10:51,659 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-20 15:10:51,659 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 15:10:51,659 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-20 15:10:51,661 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-20 15:10:51,661 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 15:10:51,660 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 15:10:51,662 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-20 15:10:51,663 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-20 15:10:51,663 DEBUG [Listener at jenkins-hbase4.apache.org/33267] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 15:10:51,661 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-20 15:10:51,663 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-20 15:10:51,663 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46155,1689865822636' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-20 15:10:51,663 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-20 15:10:51,663 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37315,1689865822568' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-20 15:10:51,663 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41343,1689865822688' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-20 15:10:51,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-20 15:10:51,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-20 15:10:51,664 DEBUG [Listener at jenkins-hbase4.apache.org/33267] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-20 15:10:51,665 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:51,669 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:10:51,669 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:51,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:10:51,670 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:10:51,670 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:51,670 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:51,670 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 15:10:51,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:10:51,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:10:51,670 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:51,670 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 15:10:51,670 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:51,670 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 15:10:51,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:10:51,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:10:51,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:51,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:10:51,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:10:51,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:10:51,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:10:51,673 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37315,1689865822568' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-20 15:10:51,673 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5ee3a041[Count = 1] remaining members to acquire global barrier 2023-07-20 15:10:51,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:10:51,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:10:51,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:10:51,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:10:51,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:10:51,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:51,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:10:51,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:10:51,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:10:51,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:10:51,677 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41343,1689865822688' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-20 15:10:51,677 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5ee3a041[Count = 0] remaining members to acquire global barrier 2023-07-20 15:10:51,677 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-20 15:10:51,677 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:51,678 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:51,678 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:51,678 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:51,678 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:51,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:51,678 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:51,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:51,678 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-20 15:10:51,679 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-20 15:10:51,678 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:51,679 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-20 15:10:51,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:51,679 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,46155,1689865822636' in zk 2023-07-20 15:10:51,679 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-20 15:10:51,679 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 15:10:51,679 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 15:10:51,679 DEBUG [rs(jenkins-hbase4.apache.org,37315,1689865822568)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689865850845.91b8c368f83d8f27c1299205661af241. 2023-07-20 15:10:51,679 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 15:10:51,679 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 15:10:51,679 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:10:51,679 DEBUG [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689865850845.6aa8e86dde429a3305ec424a45815a47. 2023-07-20 15:10:51,679 DEBUG [rs(jenkins-hbase4.apache.org,37315,1689865822568)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689865850845.91b8c368f83d8f27c1299205661af241. started... 2023-07-20 15:10:51,679 DEBUG [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689865850845.6aa8e86dde429a3305ec424a45815a47. started... 2023-07-20 15:10:51,681 DEBUG [rs(jenkins-hbase4.apache.org,37315,1689865822568)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 91b8c368f83d8f27c1299205661af241: 2023-07-20 15:10:51,681 DEBUG [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6aa8e86dde429a3305ec424a45815a47: 2023-07-20 15:10:51,681 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:10:51,681 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-20 15:10:51,681 DEBUG [rs(jenkins-hbase4.apache.org,37315,1689865822568)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689865850845.91b8c368f83d8f27c1299205661af241.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:51,681 DEBUG [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689865850845.6aa8e86dde429a3305ec424a45815a47.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:51,681 DEBUG [rs(jenkins-hbase4.apache.org,37315,1689865822568)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 15:10:51,681 DEBUG [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 15:10:51,681 DEBUG [rs(jenkins-hbase4.apache.org,37315,1689865822568)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-20 15:10:51,681 DEBUG [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-20 15:10:51,682 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-20 15:10:51,682 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 15:10:51,682 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-20 15:10:51,706 DEBUG [rs(jenkins-hbase4.apache.org,37315,1689865822568)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689865850845.91b8c368f83d8f27c1299205661af241. completed. 2023-07-20 15:10:51,706 DEBUG [rs(jenkins-hbase4.apache.org,37315,1689865822568)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689865850845.91b8c368f83d8f27c1299205661af241. 2023-07-20 15:10:51,706 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 15:10:51,706 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 15:10:51,707 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:10:51,707 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-20 15:10:51,707 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37315,1689865822568' in zk 2023-07-20 15:10:51,708 DEBUG [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689865850845.6aa8e86dde429a3305ec424a45815a47. completed. 2023-07-20 15:10:51,708 DEBUG [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689865850845.6aa8e86dde429a3305ec424a45815a47. 2023-07-20 15:10:51,708 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 15:10:51,708 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 15:10:51,708 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:10:51,709 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-20 15:10:51,709 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,41343,1689865822688' in zk 2023-07-20 15:10:51,709 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-20 15:10:51,709 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:10:51,709 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 15:10:51,710 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-20 15:10:51,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:10:51,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:10:51,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:10:51,712 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:10:51,712 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-20 15:10:51,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:10:51,713 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 15:10:51,713 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-20 15:10:51,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:10:51,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:51,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:10:51,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:10:51,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:10:51,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:10:51,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:51,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:10:51,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:10:51,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:10:51,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,37315,1689865822568': 2023-07-20 15:10:51,722 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37315,1689865822568' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-20 15:10:51,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:10:51,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:10:51,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:10:51,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:10:51,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:10:51,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:51,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:10:51,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:10:51,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:10:51,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:10:51,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:51,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:10:51,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:10:51,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:10:51,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,41343,1689865822688': 2023-07-20 15:10:51,727 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41343,1689865822688' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-20 15:10:51,727 INFO [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-07-20 15:10:51,727 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-20 15:10:51,727 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-20 15:10:51,727 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:51,727 INFO [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-20 15:10:51,729 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:51,729 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:51,729 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:10:51,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:51,729 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:51,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:10:51,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:10:51,729 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:51,729 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:51,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:51,729 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:51,729 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:10:51,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:51,730 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:51,730 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:10:51,730 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:10:51,730 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:10:51,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:10:51,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:10:51,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:51,730 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:10:51,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:10:51,730 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:10:51,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:51,731 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:10:51,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:10:51,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:51,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:51,733 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:10:51,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:10:51,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:51,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:51,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:10:51,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:10:51,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:10:51,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:10:51,735 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:10:51,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:51,735 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:10:51,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:10:51,736 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:10:51,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:10:51,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:10:51,743 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:10:51,743 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:10:51,743 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:10:51,743 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:10:51,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:10:51,743 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:10:51,743 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:10:51,743 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:10:51,743 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:51,743 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:10:51,743 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:51,743 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:10:51,743 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-07-20 15:10:51,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:10:51,743 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:10:51,743 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:51,743 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 15:10:51,743 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:10:51,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:10:51,745 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:10:51,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:10:51,745 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:10:51,743 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-20 15:10:51,745 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:51,745 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:10:51,745 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:10:51,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:10:51,745 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:10:51,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:10:51,745 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:51,746 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:10:51,746 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:10:51,746 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:51,746 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:51,746 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-20 15:10:51,756 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:51,757 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:51,789 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:51,819 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-20 15:10:51,819 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:51,819 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:51,819 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689865851558Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1689865851756 (+198 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1689865851756Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1689865851756Writing data manifest for emptySnaptb0-testExportFileSystemState at 1689865851767 (+11 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1689865851779 (+12 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689865851819 (+40 ms) 2023-07-20 15:10:51,822 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-20 15:10:51,824 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 263 msec 2023-07-20 15:10:51,865 DEBUG [Listener at jenkins-hbase4.apache.org/33267] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 15:10:51,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-20 15:10:51,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-20 15:10:51,870 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41343] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1689865850845.6aa8e86dde429a3305ec424a45815a47. with WAL disabled. Data may be lost in the event of a crash. 2023-07-20 15:10:51,872 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37315] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1689865850845.91b8c368f83d8f27c1299205661af241. with WAL disabled. Data may be lost in the event of a crash. 2023-07-20 15:10:51,876 DEBUG [Listener at jenkins-hbase4.apache.org/33267] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-20 15:10:51,876 DEBUG [Listener at jenkins-hbase4.apache.org/33267] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689865850845.6aa8e86dde429a3305ec424a45815a47. 2023-07-20 15:10:51,876 INFO [Listener at jenkins-hbase4.apache.org/33267] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-20 15:10:51,889 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-20 15:10:51,889 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689865851889 (current time:1689865851889). 2023-07-20 15:10:51,889 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-20 15:10:51,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] zookeeper.ReadOnlyZKClient(139): Connect 0x08c54ea6 to 127.0.0.1:64446 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 15:10:51,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2196e422, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 15:10:51,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 15:10:51,904 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47118, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 15:10:51,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x08c54ea6 to 127.0.0.1:64446 2023-07-20 15:10:51,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 15:10:51,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] zookeeper.ReadOnlyZKClient(139): Connect 0x26360c69 to 127.0.0.1:64446 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 15:10:51,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@12858535, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 15:10:51,916 DEBUG [hconnection-0x13e40a76-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 15:10:51,918 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47124, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 15:10:51,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 15:10:51,925 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55650, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 15:10:51,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x26360c69 to 127.0.0.1:64446 2023-07-20 15:10:51,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 15:10:51,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-20 15:10:51,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-20 15:10:51,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-20 15:10:51,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-20 15:10:51,932 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-20 15:10:51,933 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689866451933 2023-07-20 15:10:51,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-20 15:10:51,933 DEBUG [Listener at jenkins-hbase4.apache.org/33267] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-20 15:10:51,934 DEBUG [Listener at jenkins-hbase4.apache.org/33267] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-20 15:10:51,934 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-20 15:10:51,936 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-20 15:10:51,937 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-20 15:10:51,938 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-07-20 15:10:51,939 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-20 15:10:51,940 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689866451940 2023-07-20 15:10:51,958 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-07-20 15:10:51,958 INFO [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-07-20 15:10:51,958 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 15:10:51,960 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-07-20 15:10:51,960 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-20 15:10:51,960 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 15:10:51,960 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-20 15:10:51,963 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:10:51,963 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:10:51,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:10:51,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:10:51,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:10:51,963 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:10:51,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:10:51,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:10:51,963 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:10:51,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:10:51,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-20 15:10:51,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-20 15:10:51,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-20 15:10:51,964 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:10:51,964 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:10:51,965 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 15:10:51,965 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 15:10:51,965 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 15:10:51,966 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:10:51,966 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-20 15:10:51,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-20 15:10:51,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-20 15:10:51,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-20 15:10:51,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-20 15:10:51,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-20 15:10:51,966 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-20 15:10:51,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-20 15:10:51,966 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-20 15:10:51,966 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-20 15:10:51,967 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-20 15:10:51,967 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-20 15:10:51,967 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-20 15:10:51,967 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 15:10:51,967 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-20 15:10:51,967 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 15:10:51,971 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-20 15:10:51,972 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-20 15:10:51,973 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-20 15:10:51,973 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 15:10:51,972 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-20 15:10:51,973 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-20 15:10:51,973 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-20 15:10:51,974 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-20 15:10:51,974 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-20 15:10:51,974 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37315,1689865822568' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-20 15:10:51,973 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46155,1689865822636' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-20 15:10:51,974 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41343,1689865822688' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-20 15:10:51,976 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:10:51,976 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 15:10:51,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:10:51,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:10:51,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:10:51,977 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:10:51,977 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 15:10:51,977 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 15:10:51,977 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 15:10:51,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:10:51,977 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 15:10:51,978 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 15:10:51,978 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 15:10:51,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:10:51,978 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 15:10:51,978 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 15:10:51,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-20 15:10:51,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:10:51,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:10:51,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:10:51,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:10:51,980 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37315,1689865822568' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-20 15:10:51,980 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2513bfa9[Count = 1] remaining members to acquire global barrier 2023-07-20 15:10:51,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:10:51,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:10:51,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:10:51,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:10:51,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:10:51,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-20 15:10:51,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:10:51,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:10:51,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:10:51,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:10:51,983 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41343,1689865822688' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-20 15:10:51,983 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2513bfa9[Count = 0] remaining members to acquire global barrier 2023-07-20 15:10:51,983 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-20 15:10:51,983 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 15:10:51,985 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 15:10:51,985 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 15:10:51,985 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 15:10:51,985 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 15:10:51,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 15:10:51,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 15:10:51,985 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:10:51,985 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-20 15:10:51,985 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 15:10:51,985 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-20 15:10:51,985 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 15:10:51,985 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-20 15:10:51,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 15:10:51,986 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:10:51,986 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-20 15:10:51,986 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-20 15:10:51,986 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,46155,1689865822636' in zk 2023-07-20 15:10:51,986 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 15:10:51,986 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 15:10:51,987 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 15:10:51,987 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 15:10:51,987 DEBUG [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689865850845.6aa8e86dde429a3305ec424a45815a47. 2023-07-20 15:10:51,987 DEBUG [rs(jenkins-hbase4.apache.org,37315,1689865822568)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689865850845.91b8c368f83d8f27c1299205661af241. 2023-07-20 15:10:51,987 DEBUG [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689865850845.6aa8e86dde429a3305ec424a45815a47. started... 2023-07-20 15:10:51,987 DEBUG [rs(jenkins-hbase4.apache.org,37315,1689865822568)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689865850845.91b8c368f83d8f27c1299205661af241. started... 2023-07-20 15:10:51,987 INFO [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 6aa8e86dde429a3305ec424a45815a47 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-20 15:10:51,987 INFO [rs(jenkins-hbase4.apache.org,37315,1689865822568)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 91b8c368f83d8f27c1299205661af241 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-20 15:10:51,989 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-20 15:10:51,989 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 15:10:51,989 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-20 15:10:52,021 INFO [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307206de9553578bc4207b38e7935c0520b29 to hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202307206de9553578bc4207b38e7935c0520b29 2023-07-20 15:10:52,034 INFO [rs(jenkins-hbase4.apache.org,37315,1689865822568)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230720a96339cae925465290c9acdd74e57d6f to hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230720a96339cae925465290c9acdd74e57d6f 2023-07-20 15:10:52,034 DEBUG [Listener at jenkins-hbase4.apache.org/33267] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 15:10:52,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-20 15:10:52,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-20 15:10:52,035 DEBUG [Listener at jenkins-hbase4.apache.org/33267] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-20 15:10:52,051 INFO [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportFileSystemState/6aa8e86dde429a3305ec424a45815a47/.tmp/cf/b8ba7d5810c94b628f6b4c79d328a099 2023-07-20 15:10:52,056 INFO [rs(jenkins-hbase4.apache.org,37315,1689865822568)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportFileSystemState/91b8c368f83d8f27c1299205661af241/.tmp/cf/d3a6d69cb85746709adbd1c37074d1ec 2023-07-20 15:10:52,059 DEBUG [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportFileSystemState/6aa8e86dde429a3305ec424a45815a47/.tmp/cf/b8ba7d5810c94b628f6b4c79d328a099 as hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportFileSystemState/6aa8e86dde429a3305ec424a45815a47/cf/b8ba7d5810c94b628f6b4c79d328a099 2023-07-20 15:10:52,066 DEBUG [rs(jenkins-hbase4.apache.org,37315,1689865822568)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportFileSystemState/91b8c368f83d8f27c1299205661af241/.tmp/cf/d3a6d69cb85746709adbd1c37074d1ec as hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportFileSystemState/91b8c368f83d8f27c1299205661af241/cf/d3a6d69cb85746709adbd1c37074d1ec 2023-07-20 15:10:52,067 INFO [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportFileSystemState/6aa8e86dde429a3305ec424a45815a47/cf/b8ba7d5810c94b628f6b4c79d328a099, entries=3, sequenceid=6, filesize=5.4 K 2023-07-20 15:10:52,068 INFO [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 6aa8e86dde429a3305ec424a45815a47 in 81ms, sequenceid=6, compaction requested=false 2023-07-20 15:10:52,068 DEBUG [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-20 15:10:52,069 DEBUG [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6aa8e86dde429a3305ec424a45815a47: 2023-07-20 15:10:52,069 DEBUG [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689865850845.6aa8e86dde429a3305ec424a45815a47.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-20 15:10:52,069 DEBUG [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 15:10:52,069 DEBUG [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportFileSystemState/6aa8e86dde429a3305ec424a45815a47/cf/b8ba7d5810c94b628f6b4c79d328a099] hfiles 2023-07-20 15:10:52,069 DEBUG [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportFileSystemState/6aa8e86dde429a3305ec424a45815a47/cf/b8ba7d5810c94b628f6b4c79d328a099 for snapshot=snaptb0-testExportFileSystemState 2023-07-20 15:10:52,076 INFO [rs(jenkins-hbase4.apache.org,37315,1689865822568)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportFileSystemState/91b8c368f83d8f27c1299205661af241/cf/d3a6d69cb85746709adbd1c37074d1ec, entries=47, sequenceid=6, filesize=12.8 K 2023-07-20 15:10:52,078 INFO [rs(jenkins-hbase4.apache.org,37315,1689865822568)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 91b8c368f83d8f27c1299205661af241 in 91ms, sequenceid=6, compaction requested=false 2023-07-20 15:10:52,079 DEBUG [rs(jenkins-hbase4.apache.org,37315,1689865822568)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 91b8c368f83d8f27c1299205661af241: 2023-07-20 15:10:52,080 DEBUG [rs(jenkins-hbase4.apache.org,37315,1689865822568)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689865850845.91b8c368f83d8f27c1299205661af241.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-20 15:10:52,080 DEBUG [rs(jenkins-hbase4.apache.org,37315,1689865822568)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 15:10:52,080 DEBUG [rs(jenkins-hbase4.apache.org,37315,1689865822568)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportFileSystemState/91b8c368f83d8f27c1299205661af241/cf/d3a6d69cb85746709adbd1c37074d1ec] hfiles 2023-07-20 15:10:52,080 DEBUG [rs(jenkins-hbase4.apache.org,37315,1689865822568)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportFileSystemState/91b8c368f83d8f27c1299205661af241/cf/d3a6d69cb85746709adbd1c37074d1ec for snapshot=snaptb0-testExportFileSystemState 2023-07-20 15:10:52,091 DEBUG [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689865850845.6aa8e86dde429a3305ec424a45815a47. completed. 2023-07-20 15:10:52,091 DEBUG [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689865850845.6aa8e86dde429a3305ec424a45815a47. 2023-07-20 15:10:52,091 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 15:10:52,091 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 15:10:52,091 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:10:52,092 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-20 15:10:52,092 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,41343,1689865822688' in zk 2023-07-20 15:10:52,097 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-20 15:10:52,097 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:10:52,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:10:52,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:10:52,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:10:52,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:10:52,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:10:52,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-20 15:10:52,099 DEBUG [rs(jenkins-hbase4.apache.org,37315,1689865822568)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689865850845.91b8c368f83d8f27c1299205661af241. completed. 2023-07-20 15:10:52,099 DEBUG [rs(jenkins-hbase4.apache.org,37315,1689865822568)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689865850845.91b8c368f83d8f27c1299205661af241. 2023-07-20 15:10:52,097 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 15:10:52,099 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 15:10:52,099 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 15:10:52,099 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-20 15:10:52,101 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:10:52,101 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-20 15:10:52,101 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37315,1689865822568' in zk 2023-07-20 15:10:52,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:10:52,104 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-20 15:10:52,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:10:52,104 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 15:10:52,104 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:10:52,104 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-20 15:10:52,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:10:52,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:10:52,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-20 15:10:52,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:10:52,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:10:52,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:10:52,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,41343,1689865822688': 2023-07-20 15:10:52,109 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41343,1689865822688' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-20 15:10:52,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:10:52,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:10:52,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:10:52,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:10:52,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:10:52,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-20 15:10:52,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:10:52,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:10:52,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:10:52,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:10:52,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-20 15:10:52,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:10:52,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:10:52,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:10:52,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,37315,1689865822568': 2023-07-20 15:10:52,115 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37315,1689865822568' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-20 15:10:52,115 INFO [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-07-20 15:10:52,116 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-20 15:10:52,116 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-20 15:10:52,116 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-07-20 15:10:52,116 INFO [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-20 15:10:52,118 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 15:10:52,118 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 15:10:52,118 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:10:52,118 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 15:10:52,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 15:10:52,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:10:52,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:10:52,118 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 15:10:52,118 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 15:10:52,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 15:10:52,118 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:10:52,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:10:52,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 15:10:52,119 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:10:52,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:10:52,119 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:10:52,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 15:10:52,119 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:10:52,120 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:10:52,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-20 15:10:52,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:10:52,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 15:10:52,120 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:10:52,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:10:52,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-20 15:10:52,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:10:52,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:10:52,123 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 15:10:52,123 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:10:52,123 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 15:10:52,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 15:10:52,124 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:10:52,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:10:52,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 15:10:52,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:10:52,127 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:10:52,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:10:52,127 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:10:52,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-20 15:10:52,127 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:10:52,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:10:52,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:10:52,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:10:52,130 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:10:52,130 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:10:52,130 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:10:52,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:10:52,131 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:10:52,130 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:10:52,131 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 15:10:52,131 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:10:52,131 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:10:52,131 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-07-20 15:10:52,132 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:10:52,132 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-07-20 15:10:52,131 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:10:52,133 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-20 15:10:52,131 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:10:52,133 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-20 15:10:52,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:10:52,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:10:52,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:10:52,133 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:10:52,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:10:52,133 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:10:52,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:10:52,133 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:10:52,133 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-20 15:10:52,133 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:10:52,133 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:10:52,133 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-20 15:10:52,134 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:10:52,134 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 15:10:52,134 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:10:52,134 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:10:52,134 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 15:10:52,134 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 15:10:52,134 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230720a96339cae925465290c9acdd74e57d6f, hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202307206de9553578bc4207b38e7935c0520b29] mob files 2023-07-20 15:10:52,134 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230720a96339cae925465290c9acdd74e57d6f 2023-07-20 15:10:52,134 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202307206de9553578bc4207b38e7935c0520b29 2023-07-20 15:10:52,143 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-07-20 15:10:52,144 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-20 15:10:52,176 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-20 15:10:52,206 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-20 15:10:52,206 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-20 15:10:52,206 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-20 15:10:52,206 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689865851934Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1689865852143 (+209 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1689865852143Loading Region manifests for snaptb0-testExportFileSystemState at 1689865852143Writing data manifest for snaptb0-testExportFileSystemState at 1689865852149 (+6 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1689865852167 (+18 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689865852206 (+39 ms) 2023-07-20 15:10:52,209 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-20 15:10:52,211 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 274 msec 2023-07-20 15:10:52,236 DEBUG [Listener at jenkins-hbase4.apache.org/33267] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 15:10:52,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-20 15:10:52,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-20 15:10:52,237 INFO [Listener at jenkins-hbase4.apache.org/33267] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/export-test/export-1689865852237 2023-07-20 15:10:52,237 INFO [Listener at jenkins-hbase4.apache.org/33267] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:42063, tgtDir=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/export-test/export-1689865852237, rawTgtDir=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/export-test/export-1689865852237, srcFsUri=hdfs://localhost:42063, srcDir=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b 2023-07-20 15:10:52,263 DEBUG [Listener at jenkins-hbase4.apache.org/33267] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:42063, inputRoot=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b 2023-07-20 15:10:52,263 DEBUG [Listener at jenkins-hbase4.apache.org/33267] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-170635951_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/export-test/export-1689865852237, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/export-test/export-1689865852237/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-20 15:10:52,264 INFO [Listener at jenkins-hbase4.apache.org/33267] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:42063, inputRoot=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b, snapshotDir=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-07-20 15:10:52,279 INFO [Listener at jenkins-hbase4.apache.org/33267] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/export-test/export-1689865852237/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-20 15:10:52,312 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-20 15:10:52,312 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-20 15:10:52,313 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-20 15:10:52,313 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-20 15:10:52,314 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-20 15:10:52,314 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-20 15:10:52,315 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-20 15:10:52,401 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a3c136b5-559e-274b-8286-a02c66f74c8f/hadoop-6732840183505436013.jar 2023-07-20 15:10:52,401 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-20 15:10:52,402 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-20 15:10:52,402 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-20 15:10:52,402 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-20 15:10:52,403 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-20 15:10:52,403 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-20 15:10:52,403 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-20 15:10:52,404 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-20 15:10:52,404 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-20 15:10:52,405 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-20 15:10:52,405 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-20 15:10:52,405 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-20 15:10:52,406 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-20 15:10:52,406 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-20 15:10:52,406 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-20 15:10:52,407 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-20 15:10:52,408 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 15:10:52,408 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 15:10:52,408 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 15:10:52,409 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 15:10:52,409 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 15:10:52,409 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 15:10:52,410 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 15:10:53,031 WARN [Listener at jenkins-hbase4.apache.org/33267] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-20 15:10:53,034 INFO [Listener at jenkins-hbase4.apache.org/33267] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-07-20 15:10:53,037 DEBUG [Listener at jenkins-hbase4.apache.org/33267] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-07-20 15:10:54,399 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-20 15:10:54,399 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-20 15:10:54,405 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689865830265_0001_000001 (auth:SIMPLE) 2023-07-20 15:10:54,566 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689865830265_0002_000001 (auth:SIMPLE) 2023-07-20 15:10:56,108 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-20 15:10:59,243 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689865830265_0002_000001 (auth:SIMPLE) 2023-07-20 15:11:01,457 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689865830265_0002_000001 (auth:SIMPLE) 2023-07-20 15:11:05,279 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689865830265_0002_000001 (auth:SIMPLE) 2023-07-20 15:11:07,252 INFO [Listener at jenkins-hbase4.apache.org/33267] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-20 15:11:07,253 INFO [Listener at jenkins-hbase4.apache.org/33267] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-20 15:11:07,263 INFO [Listener at jenkins-hbase4.apache.org/33267] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-07-20 15:11:07,263 INFO [Listener at jenkins-hbase4.apache.org/33267] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-20 15:11:07,264 INFO [Listener at jenkins-hbase4.apache.org/33267] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-20 15:11:07,264 DEBUG [Listener at jenkins-hbase4.apache.org/33267] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_478830040_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-20 15:11:07,265 DEBUG [Listener at jenkins-hbase4.apache.org/33267] snapshot.TestExportSnapshot(367): hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-20 15:11:07,265 DEBUG [Listener at jenkins-hbase4.apache.org/33267] snapshot.TestExportSnapshot(367): hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-20 15:11:07,265 DEBUG [Listener at jenkins-hbase4.apache.org/33267] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_478830040_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/export-test/export-1689865852237/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/export-test/export-1689865852237/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-20 15:11:07,266 DEBUG [Listener at jenkins-hbase4.apache.org/33267] snapshot.TestExportSnapshot(367): hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/export-test/export-1689865852237/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-20 15:11:07,266 DEBUG [Listener at jenkins-hbase4.apache.org/33267] snapshot.TestExportSnapshot(367): hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/export-test/export-1689865852237/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-20 15:11:07,273 INFO [Listener at jenkins-hbase4.apache.org/33267] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-07-20 15:11:07,274 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-07-20 15:11:07,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] procedure2.ProcedureExecutor(1029): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-07-20 15:11:07,280 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-20 15:11:07,281 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689865867280"}]},"ts":"1689865867280"} 2023-07-20 15:11:07,282 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-07-20 15:11:07,284 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-07-20 15:11:07,285 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6aa8e86dde429a3305ec424a45815a47, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=91b8c368f83d8f27c1299205661af241, UNASSIGN}] 2023-07-20 15:11:07,287 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6aa8e86dde429a3305ec424a45815a47, UNASSIGN 2023-07-20 15:11:07,287 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=91b8c368f83d8f27c1299205661af241, UNASSIGN 2023-07-20 15:11:07,288 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=6aa8e86dde429a3305ec424a45815a47, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:11:07,288 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=91b8c368f83d8f27c1299205661af241, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:11:07,288 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689865850845.91b8c368f83d8f27c1299205661af241.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689865867288"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689865867288"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689865867288"}]},"ts":"1689865867288"} 2023-07-20 15:11:07,288 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689865850845.6aa8e86dde429a3305ec424a45815a47.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689865867288"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689865867288"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689865867288"}]},"ts":"1689865867288"} 2023-07-20 15:11:07,290 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=37, state=RUNNABLE; CloseRegionProcedure 6aa8e86dde429a3305ec424a45815a47, server=jenkins-hbase4.apache.org,41343,1689865822688}] 2023-07-20 15:11:07,291 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=38, state=RUNNABLE; CloseRegionProcedure 91b8c368f83d8f27c1299205661af241, server=jenkins-hbase4.apache.org,37315,1689865822568}] 2023-07-20 15:11:07,389 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-20 15:11:07,443 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 6aa8e86dde429a3305ec424a45815a47 2023-07-20 15:11:07,443 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6aa8e86dde429a3305ec424a45815a47, disabling compactions & flushes 2023-07-20 15:11:07,443 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689865850845.6aa8e86dde429a3305ec424a45815a47. 2023-07-20 15:11:07,443 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689865850845.6aa8e86dde429a3305ec424a45815a47. 2023-07-20 15:11:07,443 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689865850845.6aa8e86dde429a3305ec424a45815a47. after waiting 0 ms 2023-07-20 15:11:07,443 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689865850845.6aa8e86dde429a3305ec424a45815a47. 2023-07-20 15:11:07,443 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 91b8c368f83d8f27c1299205661af241 2023-07-20 15:11:07,448 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 91b8c368f83d8f27c1299205661af241, disabling compactions & flushes 2023-07-20 15:11:07,448 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689865850845.91b8c368f83d8f27c1299205661af241. 2023-07-20 15:11:07,448 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689865850845.91b8c368f83d8f27c1299205661af241. 2023-07-20 15:11:07,448 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689865850845.91b8c368f83d8f27c1299205661af241. after waiting 0 ms 2023-07-20 15:11:07,448 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689865850845.91b8c368f83d8f27c1299205661af241. 2023-07-20 15:11:07,470 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportFileSystemState/6aa8e86dde429a3305ec424a45815a47/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-20 15:11:07,470 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportFileSystemState/91b8c368f83d8f27c1299205661af241/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-20 15:11:07,471 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 15:11:07,471 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 15:11:07,472 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689865850845.91b8c368f83d8f27c1299205661af241. 2023-07-20 15:11:07,472 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689865850845.6aa8e86dde429a3305ec424a45815a47. 2023-07-20 15:11:07,472 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 91b8c368f83d8f27c1299205661af241: 2023-07-20 15:11:07,472 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6aa8e86dde429a3305ec424a45815a47: 2023-07-20 15:11:07,474 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 91b8c368f83d8f27c1299205661af241 2023-07-20 15:11:07,475 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=91b8c368f83d8f27c1299205661af241, regionState=CLOSED 2023-07-20 15:11:07,476 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 6aa8e86dde429a3305ec424a45815a47 2023-07-20 15:11:07,476 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689865850845.91b8c368f83d8f27c1299205661af241.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689865867475"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689865867475"}]},"ts":"1689865867475"} 2023-07-20 15:11:07,476 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=6aa8e86dde429a3305ec424a45815a47, regionState=CLOSED 2023-07-20 15:11:07,477 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689865850845.6aa8e86dde429a3305ec424a45815a47.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689865867476"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689865867476"}]},"ts":"1689865867476"} 2023-07-20 15:11:07,480 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=38 2023-07-20 15:11:07,480 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=38, state=SUCCESS; CloseRegionProcedure 91b8c368f83d8f27c1299205661af241, server=jenkins-hbase4.apache.org,37315,1689865822568 in 186 msec 2023-07-20 15:11:07,481 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=37 2023-07-20 15:11:07,481 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=37, state=SUCCESS; CloseRegionProcedure 6aa8e86dde429a3305ec424a45815a47, server=jenkins-hbase4.apache.org,41343,1689865822688 in 188 msec 2023-07-20 15:11:07,482 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=91b8c368f83d8f27c1299205661af241, UNASSIGN in 196 msec 2023-07-20 15:11:07,484 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=37, resume processing ppid=36 2023-07-20 15:11:07,484 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6aa8e86dde429a3305ec424a45815a47, UNASSIGN in 197 msec 2023-07-20 15:11:07,485 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689865867485"}]},"ts":"1689865867485"} 2023-07-20 15:11:07,486 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-07-20 15:11:07,488 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-07-20 15:11:07,491 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 215 msec 2023-07-20 15:11:07,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-20 15:11:07,591 INFO [Listener at jenkins-hbase4.apache.org/33267] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-07-20 15:11:07,592 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-07-20 15:11:07,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] procedure2.ProcedureExecutor(1029): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-20 15:11:07,596 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-20 15:11:07,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-07-20 15:11:07,596 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-20 15:11:07,598 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41343] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-07-20 15:11:07,601 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testExportFileSystemState/6aa8e86dde429a3305ec424a45815a47 2023-07-20 15:11:07,601 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testExportFileSystemState/91b8c368f83d8f27c1299205661af241 2023-07-20 15:11:07,602 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-20 15:11:07,602 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-20 15:11:07,603 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-20 15:11:07,603 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-20 15:11:07,603 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-20 15:11:07,603 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-20 15:11:07,603 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-20 15:11:07,603 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-20 15:11:07,603 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testExportFileSystemState/6aa8e86dde429a3305ec424a45815a47/cf, FileablePath, hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testExportFileSystemState/6aa8e86dde429a3305ec424a45815a47/recovered.edits] 2023-07-20 15:11:07,604 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testExportFileSystemState/91b8c368f83d8f27c1299205661af241/cf, FileablePath, hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testExportFileSystemState/91b8c368f83d8f27c1299205661af241/recovered.edits] 2023-07-20 15:11:07,604 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-20 15:11:07,604 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-20 15:11:07,604 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 15:11:07,604 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 15:11:07,604 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-20 15:11:07,605 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 15:11:07,605 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-20 15:11:07,605 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 15:11:07,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-20 15:11:07,608 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testExportFileSystemState/6aa8e86dde429a3305ec424a45815a47/cf/b8ba7d5810c94b628f6b4c79d328a099 to hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/archive/data/default/testtb-testExportFileSystemState/6aa8e86dde429a3305ec424a45815a47/cf/b8ba7d5810c94b628f6b4c79d328a099 2023-07-20 15:11:07,608 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testExportFileSystemState/91b8c368f83d8f27c1299205661af241/cf/d3a6d69cb85746709adbd1c37074d1ec to hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/archive/data/default/testtb-testExportFileSystemState/91b8c368f83d8f27c1299205661af241/cf/d3a6d69cb85746709adbd1c37074d1ec 2023-07-20 15:11:07,611 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testExportFileSystemState/6aa8e86dde429a3305ec424a45815a47/recovered.edits/9.seqid to hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/archive/data/default/testtb-testExportFileSystemState/6aa8e86dde429a3305ec424a45815a47/recovered.edits/9.seqid 2023-07-20 15:11:07,611 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testExportFileSystemState/91b8c368f83d8f27c1299205661af241/recovered.edits/9.seqid to hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/archive/data/default/testtb-testExportFileSystemState/91b8c368f83d8f27c1299205661af241/recovered.edits/9.seqid 2023-07-20 15:11:07,612 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testExportFileSystemState/6aa8e86dde429a3305ec424a45815a47 2023-07-20 15:11:07,612 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testExportFileSystemState/91b8c368f83d8f27c1299205661af241 2023-07-20 15:11:07,612 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-20 15:11:07,613 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-07-20 15:11:07,613 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-07-20 15:11:07,617 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230720a96339cae925465290c9acdd74e57d6f to hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230720a96339cae925465290c9acdd74e57d6f 2023-07-20 15:11:07,618 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202307206de9553578bc4207b38e7935c0520b29 to hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202307206de9553578bc4207b38e7935c0520b29 2023-07-20 15:11:07,618 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-07-20 15:11:07,621 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-20 15:11:07,623 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-07-20 15:11:07,625 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-07-20 15:11:07,626 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-20 15:11:07,626 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-07-20 15:11:07,626 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1689865850845.6aa8e86dde429a3305ec424a45815a47.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689865867626"}]},"ts":"9223372036854775807"} 2023-07-20 15:11:07,626 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1689865850845.91b8c368f83d8f27c1299205661af241.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689865867626"}]},"ts":"9223372036854775807"} 2023-07-20 15:11:07,628 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-20 15:11:07,628 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 6aa8e86dde429a3305ec424a45815a47, NAME => 'testtb-testExportFileSystemState,,1689865850845.6aa8e86dde429a3305ec424a45815a47.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 91b8c368f83d8f27c1299205661af241, NAME => 'testtb-testExportFileSystemState,1,1689865850845.91b8c368f83d8f27c1299205661af241.', STARTKEY => '1', ENDKEY => ''}] 2023-07-20 15:11:07,628 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-07-20 15:11:07,628 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689865867628"}]},"ts":"9223372036854775807"} 2023-07-20 15:11:07,630 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-07-20 15:11:07,632 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-20 15:11:07,633 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 40 msec 2023-07-20 15:11:07,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-20 15:11:07,707 INFO [Listener at jenkins-hbase4.apache.org/33267] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-07-20 15:11:07,714 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-07-20 15:11:07,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-07-20 15:11:07,718 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-07-20 15:11:07,720 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-07-20 15:11:07,746 INFO [Listener at jenkins-hbase4.apache.org/33267] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=761 (was 750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-2026 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_478830040_17 at /127.0.0.1:49128 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3c085ba2-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1833777912_1 at /127.0.0.1:47450 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1484284473) connection to jenkins-hbase4.apache.org/172.31.14.131:43843 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x3c085ba2-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3c085ba2-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1484284473) connection to jenkins-hbase4.apache.org/172.31.14.131:41267 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x3c085ba2-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_478830040_17 at /127.0.0.1:39628 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_478830040_17 at /127.0.0.1:47488 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=932 (was 920) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=358 (was 324) - SystemLoadAverage LEAK? -, ProcessCount=183 (was 183), AvailableMemoryMB=3101 (was 3434) 2023-07-20 15:11:07,746 WARN [Listener at jenkins-hbase4.apache.org/33267] hbase.ResourceChecker(130): Thread=761 is superior to 500 2023-07-20 15:11:07,768 INFO [Listener at jenkins-hbase4.apache.org/33267] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=761, OpenFileDescriptor=932, MaxFileDescriptor=60000, SystemLoadAverage=358, ProcessCount=183, AvailableMemoryMB=3100 2023-07-20 15:11:07,768 WARN [Listener at jenkins-hbase4.apache.org/33267] hbase.ResourceChecker(130): Thread=761 is superior to 500 2023-07-20 15:11:07,770 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-20 15:11:07,772 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-07-20 15:11:07,776 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-07-20 15:11:07,776 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-07-20 15:11:07,777 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-20 15:11:07,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-20 15:11:07,780 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testConsecutiveExports/b635363621057acdca183555341d1dce 2023-07-20 15:11:07,780 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testConsecutiveExports/d01e46742a6b62293647bb83f9656d56 2023-07-20 15:11:07,781 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testConsecutiveExports/b635363621057acdca183555341d1dce empty. 2023-07-20 15:11:07,781 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testConsecutiveExports/d01e46742a6b62293647bb83f9656d56 empty. 2023-07-20 15:11:07,781 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testConsecutiveExports/b635363621057acdca183555341d1dce 2023-07-20 15:11:07,781 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testConsecutiveExports/d01e46742a6b62293647bb83f9656d56 2023-07-20 15:11:07,781 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-20 15:11:07,798 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-07-20 15:11:07,799 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => b635363621057acdca183555341d1dce, NAME => 'testtb-testConsecutiveExports,,1689865867770.b635363621057acdca183555341d1dce.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp 2023-07-20 15:11:07,799 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => d01e46742a6b62293647bb83f9656d56, NAME => 'testtb-testConsecutiveExports,1,1689865867770.d01e46742a6b62293647bb83f9656d56.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp 2023-07-20 15:11:07,822 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689865867770.d01e46742a6b62293647bb83f9656d56.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 15:11:07,822 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689865867770.b635363621057acdca183555341d1dce.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 15:11:07,822 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing d01e46742a6b62293647bb83f9656d56, disabling compactions & flushes 2023-07-20 15:11:07,823 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing b635363621057acdca183555341d1dce, disabling compactions & flushes 2023-07-20 15:11:07,823 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689865867770.d01e46742a6b62293647bb83f9656d56. 2023-07-20 15:11:07,823 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689865867770.b635363621057acdca183555341d1dce. 2023-07-20 15:11:07,823 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689865867770.d01e46742a6b62293647bb83f9656d56. 2023-07-20 15:11:07,823 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689865867770.b635363621057acdca183555341d1dce. 2023-07-20 15:11:07,823 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689865867770.d01e46742a6b62293647bb83f9656d56. after waiting 0 ms 2023-07-20 15:11:07,823 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689865867770.b635363621057acdca183555341d1dce. after waiting 0 ms 2023-07-20 15:11:07,823 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689865867770.d01e46742a6b62293647bb83f9656d56. 2023-07-20 15:11:07,823 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689865867770.b635363621057acdca183555341d1dce. 2023-07-20 15:11:07,823 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689865867770.d01e46742a6b62293647bb83f9656d56. 2023-07-20 15:11:07,823 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689865867770.b635363621057acdca183555341d1dce. 2023-07-20 15:11:07,823 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for d01e46742a6b62293647bb83f9656d56: 2023-07-20 15:11:07,823 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for b635363621057acdca183555341d1dce: 2023-07-20 15:11:07,826 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-07-20 15:11:07,827 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689865867770.d01e46742a6b62293647bb83f9656d56.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689865867827"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689865867827"}]},"ts":"1689865867827"} 2023-07-20 15:11:07,827 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689865867770.b635363621057acdca183555341d1dce.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689865867827"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689865867827"}]},"ts":"1689865867827"} 2023-07-20 15:11:07,829 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-20 15:11:07,830 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-20 15:11:07,831 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689865867831"}]},"ts":"1689865867831"} 2023-07-20 15:11:07,832 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-07-20 15:11:07,837 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-20 15:11:07,838 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-20 15:11:07,838 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-20 15:11:07,838 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-20 15:11:07,838 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-20 15:11:07,838 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=b635363621057acdca183555341d1dce, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=d01e46742a6b62293647bb83f9656d56, ASSIGN}] 2023-07-20 15:11:07,841 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=d01e46742a6b62293647bb83f9656d56, ASSIGN 2023-07-20 15:11:07,841 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=b635363621057acdca183555341d1dce, ASSIGN 2023-07-20 15:11:07,842 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=d01e46742a6b62293647bb83f9656d56, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41343,1689865822688; forceNewPlan=false, retain=false 2023-07-20 15:11:07,842 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=b635363621057acdca183555341d1dce, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46155,1689865822636; forceNewPlan=false, retain=false 2023-07-20 15:11:07,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-20 15:11:07,992 INFO [jenkins-hbase4:38949] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-20 15:11:07,995 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=d01e46742a6b62293647bb83f9656d56, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:11:07,995 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=b635363621057acdca183555341d1dce, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:11:07,996 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689865867770.d01e46742a6b62293647bb83f9656d56.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689865867995"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689865867995"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689865867995"}]},"ts":"1689865867995"} 2023-07-20 15:11:07,996 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689865867770.b635363621057acdca183555341d1dce.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689865867995"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689865867995"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689865867995"}]},"ts":"1689865867995"} 2023-07-20 15:11:07,998 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE; OpenRegionProcedure d01e46742a6b62293647bb83f9656d56, server=jenkins-hbase4.apache.org,41343,1689865822688}] 2023-07-20 15:11:07,999 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=43, state=RUNNABLE; OpenRegionProcedure b635363621057acdca183555341d1dce, server=jenkins-hbase4.apache.org,46155,1689865822636}] 2023-07-20 15:11:08,080 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-20 15:11:08,159 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1689865867770.d01e46742a6b62293647bb83f9656d56. 2023-07-20 15:11:08,160 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d01e46742a6b62293647bb83f9656d56, NAME => 'testtb-testConsecutiveExports,1,1689865867770.d01e46742a6b62293647bb83f9656d56.', STARTKEY => '1', ENDKEY => ''} 2023-07-20 15:11:08,160 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1689865867770.d01e46742a6b62293647bb83f9656d56. service=AccessControlService 2023-07-20 15:11:08,160 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 15:11:08,160 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports d01e46742a6b62293647bb83f9656d56 2023-07-20 15:11:08,160 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689865867770.d01e46742a6b62293647bb83f9656d56.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 15:11:08,161 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d01e46742a6b62293647bb83f9656d56 2023-07-20 15:11:08,161 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d01e46742a6b62293647bb83f9656d56 2023-07-20 15:11:08,162 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1689865867770.b635363621057acdca183555341d1dce. 2023-07-20 15:11:08,162 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b635363621057acdca183555341d1dce, NAME => 'testtb-testConsecutiveExports,,1689865867770.b635363621057acdca183555341d1dce.', STARTKEY => '', ENDKEY => '1'} 2023-07-20 15:11:08,162 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1689865867770.b635363621057acdca183555341d1dce. service=AccessControlService 2023-07-20 15:11:08,162 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 15:11:08,162 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports b635363621057acdca183555341d1dce 2023-07-20 15:11:08,162 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689865867770.b635363621057acdca183555341d1dce.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 15:11:08,162 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b635363621057acdca183555341d1dce 2023-07-20 15:11:08,163 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b635363621057acdca183555341d1dce 2023-07-20 15:11:08,164 INFO [StoreOpener-b635363621057acdca183555341d1dce-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region b635363621057acdca183555341d1dce 2023-07-20 15:11:08,165 DEBUG [StoreOpener-b635363621057acdca183555341d1dce-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testConsecutiveExports/b635363621057acdca183555341d1dce/cf 2023-07-20 15:11:08,166 DEBUG [StoreOpener-b635363621057acdca183555341d1dce-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testConsecutiveExports/b635363621057acdca183555341d1dce/cf 2023-07-20 15:11:08,166 INFO [StoreOpener-d01e46742a6b62293647bb83f9656d56-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region d01e46742a6b62293647bb83f9656d56 2023-07-20 15:11:08,166 INFO [StoreOpener-b635363621057acdca183555341d1dce-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b635363621057acdca183555341d1dce columnFamilyName cf 2023-07-20 15:11:08,167 DEBUG [StoreOpener-d01e46742a6b62293647bb83f9656d56-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testConsecutiveExports/d01e46742a6b62293647bb83f9656d56/cf 2023-07-20 15:11:08,167 DEBUG [StoreOpener-d01e46742a6b62293647bb83f9656d56-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testConsecutiveExports/d01e46742a6b62293647bb83f9656d56/cf 2023-07-20 15:11:08,168 INFO [StoreOpener-b635363621057acdca183555341d1dce-1] regionserver.HStore(310): Store=b635363621057acdca183555341d1dce/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 15:11:08,168 INFO [StoreOpener-d01e46742a6b62293647bb83f9656d56-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d01e46742a6b62293647bb83f9656d56 columnFamilyName cf 2023-07-20 15:11:08,169 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testConsecutiveExports/b635363621057acdca183555341d1dce 2023-07-20 15:11:08,169 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testConsecutiveExports/b635363621057acdca183555341d1dce 2023-07-20 15:11:08,170 INFO [StoreOpener-d01e46742a6b62293647bb83f9656d56-1] regionserver.HStore(310): Store=d01e46742a6b62293647bb83f9656d56/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 15:11:08,171 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testConsecutiveExports/d01e46742a6b62293647bb83f9656d56 2023-07-20 15:11:08,171 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testConsecutiveExports/d01e46742a6b62293647bb83f9656d56 2023-07-20 15:11:08,173 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b635363621057acdca183555341d1dce 2023-07-20 15:11:08,175 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d01e46742a6b62293647bb83f9656d56 2023-07-20 15:11:08,176 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testConsecutiveExports/b635363621057acdca183555341d1dce/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 15:11:08,177 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b635363621057acdca183555341d1dce; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66204743, jitterRate=-0.013472452759742737}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 15:11:08,177 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b635363621057acdca183555341d1dce: 2023-07-20 15:11:08,177 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testConsecutiveExports/d01e46742a6b62293647bb83f9656d56/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 15:11:08,178 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1689865867770.b635363621057acdca183555341d1dce., pid=46, masterSystemTime=1689865868154 2023-07-20 15:11:08,178 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d01e46742a6b62293647bb83f9656d56; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70167558, jitterRate=0.04557809233665466}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 15:11:08,178 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d01e46742a6b62293647bb83f9656d56: 2023-07-20 15:11:08,179 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1689865867770.d01e46742a6b62293647bb83f9656d56., pid=45, masterSystemTime=1689865868152 2023-07-20 15:11:08,180 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1689865867770.b635363621057acdca183555341d1dce. 2023-07-20 15:11:08,180 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1689865867770.b635363621057acdca183555341d1dce. 2023-07-20 15:11:08,181 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=b635363621057acdca183555341d1dce, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:11:08,181 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1689865867770.d01e46742a6b62293647bb83f9656d56. 2023-07-20 15:11:08,181 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1689865867770.b635363621057acdca183555341d1dce.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689865868181"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689865868181"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689865868181"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689865868181"}]},"ts":"1689865868181"} 2023-07-20 15:11:08,181 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1689865867770.d01e46742a6b62293647bb83f9656d56. 2023-07-20 15:11:08,182 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=d01e46742a6b62293647bb83f9656d56, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:11:08,182 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1689865867770.d01e46742a6b62293647bb83f9656d56.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689865868182"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689865868182"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689865868182"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689865868182"}]},"ts":"1689865868182"} 2023-07-20 15:11:08,186 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=43 2023-07-20 15:11:08,186 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=43, state=SUCCESS; OpenRegionProcedure b635363621057acdca183555341d1dce, server=jenkins-hbase4.apache.org,46155,1689865822636 in 184 msec 2023-07-20 15:11:08,191 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=44 2023-07-20 15:11:08,192 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=b635363621057acdca183555341d1dce, ASSIGN in 348 msec 2023-07-20 15:11:08,192 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=44, state=SUCCESS; OpenRegionProcedure d01e46742a6b62293647bb83f9656d56, server=jenkins-hbase4.apache.org,41343,1689865822688 in 186 msec 2023-07-20 15:11:08,194 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=42 2023-07-20 15:11:08,194 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=d01e46742a6b62293647bb83f9656d56, ASSIGN in 354 msec 2023-07-20 15:11:08,195 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-20 15:11:08,195 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689865868195"}]},"ts":"1689865868195"} 2023-07-20 15:11:08,197 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-07-20 15:11:08,200 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-07-20 15:11:08,200 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-07-20 15:11:08,203 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41343] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-20 15:11:08,204 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 15:11:08,204 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 15:11:08,204 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 15:11:08,204 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 15:11:08,206 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-20 15:11:08,206 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-20 15:11:08,206 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-20 15:11:08,206 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-20 15:11:08,208 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 436 msec 2023-07-20 15:11:08,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-20 15:11:08,382 INFO [Listener at jenkins-hbase4.apache.org/33267] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-07-20 15:11:08,385 DEBUG [Listener at jenkins-hbase4.apache.org/33267] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-20 15:11:08,385 DEBUG [Listener at jenkins-hbase4.apache.org/33267] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689865867770.b635363621057acdca183555341d1dce. 2023-07-20 15:11:08,388 INFO [Listener at jenkins-hbase4.apache.org/33267] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-20 15:11:08,403 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-20 15:11:08,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689865868403 (current time:1689865868403). 2023-07-20 15:11:08,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-20 15:11:08,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] zookeeper.ReadOnlyZKClient(139): Connect 0x26201473 to 127.0.0.1:64446 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 15:11:08,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4f5f2175, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 15:11:08,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 15:11:08,415 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37704, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 15:11:08,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x26201473 to 127.0.0.1:64446 2023-07-20 15:11:08,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 15:11:08,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] zookeeper.ReadOnlyZKClient(139): Connect 0x1f33f992 to 127.0.0.1:64446 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 15:11:08,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3996f58b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 15:11:08,425 DEBUG [hconnection-0xff42f45-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 15:11:08,428 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37718, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 15:11:08,432 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 15:11:08,435 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54320, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 15:11:08,436 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1f33f992 to 127.0.0.1:64446 2023-07-20 15:11:08,436 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 15:11:08,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-20 15:11:08,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-20 15:11:08,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-20 15:11:08,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] procedure2.ProcedureExecutor(1029): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-20 15:11:08,442 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-20 15:11:08,443 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689866468443 2023-07-20 15:11:08,443 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-20 15:11:08,443 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-20 15:11:08,445 DEBUG [Listener at jenkins-hbase4.apache.org/33267] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-20 15:11:08,445 DEBUG [Listener at jenkins-hbase4.apache.org/33267] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-20 15:11:08,447 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-20 15:11:08,450 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-20 15:11:08,451 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 11 msec 2023-07-20 15:11:08,452 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-20 15:11:08,453 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689866468453 2023-07-20 15:11:08,473 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:08,473 INFO [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-07-20 15:11:08,473 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 15:11:08,474 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-07-20 15:11:08,474 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-20 15:11:08,475 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:08,475 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:08,476 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:11:08,476 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:11:08,476 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:11:08,476 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:11:08,476 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:11:08,476 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:11:08,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:11:08,477 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:11:08,477 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:11:08,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:11:08,477 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:11:08,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:11:08,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:08,477 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:11:08,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:08,477 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:08,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:08,477 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-20 15:11:08,478 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:08,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-20 15:11:08,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:08,478 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:08,478 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-20 15:11:08,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-20 15:11:08,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:08,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-20 15:11:08,478 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-20 15:11:08,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:08,478 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:08,479 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-20 15:11:08,479 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-20 15:11:08,479 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 15:11:08,480 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-20 15:11:08,480 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:08,480 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:08,480 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-20 15:11:08,480 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-20 15:11:08,480 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 15:11:08,480 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-20 15:11:08,481 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-20 15:11:08,481 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-20 15:11:08,481 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37315,1689865822568' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-20 15:11:08,480 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46155,1689865822636' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-20 15:11:08,481 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 15:11:08,486 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-20 15:11:08,486 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-20 15:11:08,486 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41343,1689865822688' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-20 15:11:08,488 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:08,488 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:11:08,488 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:08,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:11:08,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:11:08,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:11:08,489 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:11:08,489 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:08,489 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:08,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:11:08,489 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:08,489 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 15:11:08,489 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 15:11:08,489 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:08,489 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 15:11:08,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:11:08,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:08,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:11:08,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:11:08,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:11:08,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:11:08,492 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46155,1689865822636' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-20 15:11:08,492 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@132a0f47[Count = 1] remaining members to acquire global barrier 2023-07-20 15:11:08,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:11:08,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:11:08,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:11:08,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:11:08,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:11:08,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:08,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:11:08,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:11:08,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:11:08,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:11:08,494 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41343,1689865822688' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-20 15:11:08,494 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@132a0f47[Count = 0] remaining members to acquire global barrier 2023-07-20 15:11:08,494 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-20 15:11:08,494 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:08,496 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:08,496 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:08,496 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:08,496 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:08,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:08,496 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:08,496 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-20 15:11:08,496 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-20 15:11:08,496 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,37315,1689865822568' in zk 2023-07-20 15:11:08,496 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:08,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:08,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:08,496 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-20 15:11:08,496 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:11:08,496 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-20 15:11:08,496 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 15:11:08,497 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 15:11:08,497 DEBUG [rs(jenkins-hbase4.apache.org,46155,1689865822636)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689865867770.b635363621057acdca183555341d1dce. 2023-07-20 15:11:08,497 DEBUG [rs(jenkins-hbase4.apache.org,46155,1689865822636)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689865867770.b635363621057acdca183555341d1dce. started... 2023-07-20 15:11:08,497 DEBUG [rs(jenkins-hbase4.apache.org,46155,1689865822636)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b635363621057acdca183555341d1dce: 2023-07-20 15:11:08,497 DEBUG [rs(jenkins-hbase4.apache.org,46155,1689865822636)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689865867770.b635363621057acdca183555341d1dce.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:08,497 DEBUG [rs(jenkins-hbase4.apache.org,46155,1689865822636)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 15:11:08,497 DEBUG [rs(jenkins-hbase4.apache.org,46155,1689865822636)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-20 15:11:08,498 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 15:11:08,498 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 15:11:08,498 DEBUG [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689865867770.d01e46742a6b62293647bb83f9656d56. 2023-07-20 15:11:08,498 DEBUG [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689865867770.d01e46742a6b62293647bb83f9656d56. started... 2023-07-20 15:11:08,500 DEBUG [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d01e46742a6b62293647bb83f9656d56: 2023-07-20 15:11:08,500 DEBUG [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689865867770.d01e46742a6b62293647bb83f9656d56.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:08,501 DEBUG [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 15:11:08,501 DEBUG [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-20 15:11:08,502 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-20 15:11:08,502 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:11:08,502 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 15:11:08,502 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-20 15:11:08,502 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-20 15:11:08,514 DEBUG [rs(jenkins-hbase4.apache.org,46155,1689865822636)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689865867770.b635363621057acdca183555341d1dce. completed. 2023-07-20 15:11:08,514 DEBUG [rs(jenkins-hbase4.apache.org,46155,1689865822636)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689865867770.b635363621057acdca183555341d1dce. 2023-07-20 15:11:08,514 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 15:11:08,514 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 15:11:08,514 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:11:08,514 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-20 15:11:08,514 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,46155,1689865822636' in zk 2023-07-20 15:11:08,520 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-20 15:11:08,520 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:11:08,520 DEBUG [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689865867770.d01e46742a6b62293647bb83f9656d56. completed. 2023-07-20 15:11:08,520 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 15:11:08,520 DEBUG [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689865867770.d01e46742a6b62293647bb83f9656d56. 2023-07-20 15:11:08,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:11:08,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:11:08,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:11:08,521 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 15:11:08,523 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 15:11:08,523 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:11:08,523 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-20 15:11:08,523 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,41343,1689865822688' in zk 2023-07-20 15:11:08,520 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-20 15:11:08,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:11:08,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:11:08,525 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:11:08,525 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-20 15:11:08,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:08,525 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 15:11:08,525 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-20 15:11:08,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:11:08,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:11:08,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:11:08,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:11:08,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:08,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:11:08,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:11:08,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:11:08,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,46155,1689865822636': 2023-07-20 15:11:08,531 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46155,1689865822636' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-20 15:11:08,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:11:08,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:11:08,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:11:08,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:11:08,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:11:08,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:08,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:11:08,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:11:08,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:11:08,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:11:08,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:08,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:11:08,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:11:08,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:11:08,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,41343,1689865822688': 2023-07-20 15:11:08,536 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41343,1689865822688' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-20 15:11:08,536 INFO [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-07-20 15:11:08,536 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-20 15:11:08,536 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-20 15:11:08,536 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:08,536 INFO [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-20 15:11:08,539 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:08,539 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:08,539 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:08,540 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:08,540 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:08,540 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:08,539 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:11:08,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:08,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:08,540 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:11:08,540 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:11:08,539 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:08,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:08,545 DEBUG [Listener at jenkins-hbase4.apache.org/33267] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 15:11:08,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:08,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:11:08,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:11:08,545 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:11:08,545 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:11:08,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:11:08,546 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:11:08,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:11:08,546 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:11:08,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:08,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:11:08,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:11:08,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:08,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-20 15:11:08,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-20 15:11:08,547 DEBUG [Listener at jenkins-hbase4.apache.org/33267] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-20 15:11:08,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:08,548 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:11:08,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:08,548 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:11:08,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:11:08,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:08,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:11:08,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:11:08,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:11:08,551 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:11:08,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:11:08,551 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:11:08,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:08,552 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:11:08,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:11:08,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:11:08,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:11:08,556 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:11:08,556 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:11:08,556 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:11:08,556 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:11:08,556 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:11:08,556 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:08,556 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 15:11:08,556 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:11:08,558 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:11:08,558 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:08,558 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:11:08,558 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:08,558 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:11:08,558 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:11:08,558 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:08,558 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:08,556 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:08,556 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:11:08,556 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:11:08,556 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:11:08,556 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:11:08,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:11:08,556 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:11:08,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:11:08,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:11:08,558 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-07-20 15:11:08,559 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:11:08,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:11:08,559 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:11:08,559 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:08,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:11:08,559 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-20 15:11:08,559 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:11:08,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:11:08,560 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-20 15:11:08,578 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:08,579 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:08,635 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:08,748 DEBUG [Listener at jenkins-hbase4.apache.org/33267] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 15:11:08,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-20 15:11:08,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-20 15:11:08,749 DEBUG [Listener at jenkins-hbase4.apache.org/33267] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-20 15:11:09,049 DEBUG [Listener at jenkins-hbase4.apache.org/33267] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 15:11:09,050 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-20 15:11:09,050 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-20 15:11:09,051 DEBUG [Listener at jenkins-hbase4.apache.org/33267] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-20 15:11:09,065 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-20 15:11:09,065 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:09,065 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:09,065 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689865868444Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1689865868578 (+134 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1689865868578Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1689865868578Writing data manifest for emptySnaptb0-testConsecutiveExports at 1689865868583 (+5 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1689865868627 (+44 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689865869065 (+438 ms) 2023-07-20 15:11:09,068 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-20 15:11:09,069 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 623 msec 2023-07-20 15:11:09,551 DEBUG [Listener at jenkins-hbase4.apache.org/33267] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 15:11:09,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-20 15:11:09,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-20 15:11:09,556 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46155] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1689865867770.b635363621057acdca183555341d1dce. with WAL disabled. Data may be lost in the event of a crash. 2023-07-20 15:11:09,557 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41343] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1689865867770.d01e46742a6b62293647bb83f9656d56. with WAL disabled. Data may be lost in the event of a crash. 2023-07-20 15:11:09,561 DEBUG [Listener at jenkins-hbase4.apache.org/33267] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-20 15:11:09,561 DEBUG [Listener at jenkins-hbase4.apache.org/33267] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689865867770.b635363621057acdca183555341d1dce. 2023-07-20 15:11:09,561 INFO [Listener at jenkins-hbase4.apache.org/33267] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-20 15:11:09,572 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-20 15:11:09,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689865869572 (current time:1689865869572). 2023-07-20 15:11:09,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-20 15:11:09,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] zookeeper.ReadOnlyZKClient(139): Connect 0x29f33f68 to 127.0.0.1:64446 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 15:11:09,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2e7c1eab, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 15:11:09,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 15:11:09,586 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37722, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 15:11:09,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x29f33f68 to 127.0.0.1:64446 2023-07-20 15:11:09,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 15:11:09,588 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] zookeeper.ReadOnlyZKClient(139): Connect 0x04c013df to 127.0.0.1:64446 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 15:11:09,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@34786450, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 15:11:09,596 DEBUG [hconnection-0x7abfbd32-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 15:11:09,599 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37738, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 15:11:09,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 15:11:09,604 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54336, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 15:11:09,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x04c013df to 127.0.0.1:64446 2023-07-20 15:11:09,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 15:11:09,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-20 15:11:09,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-20 15:11:09,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-20 15:11:09,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-20 15:11:09,610 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-20 15:11:09,611 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689866469611 2023-07-20 15:11:09,611 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-20 15:11:09,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-20 15:11:09,612 DEBUG [Listener at jenkins-hbase4.apache.org/33267] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-20 15:11:09,612 DEBUG [Listener at jenkins-hbase4.apache.org/33267] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-20 15:11:09,613 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-20 15:11:09,613 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-20 15:11:09,614 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 5 msec 2023-07-20 15:11:09,615 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-20 15:11:09,616 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689866469616 2023-07-20 15:11:09,625 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-07-20 15:11:09,625 INFO [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-07-20 15:11:09,625 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 15:11:09,626 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-07-20 15:11:09,626 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-20 15:11:09,627 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 15:11:09,627 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-20 15:11:09,628 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:11:09,628 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:11:09,628 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:11:09,628 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:11:09,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:11:09,628 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:11:09,628 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:11:09,629 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:11:09,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:11:09,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:11:09,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-20 15:11:09,629 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:11:09,629 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:11:09,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-20 15:11:09,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-20 15:11:09,629 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 15:11:09,629 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 15:11:09,629 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 15:11:09,629 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:11:09,630 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-20 15:11:09,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-20 15:11:09,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-20 15:11:09,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-20 15:11:09,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-20 15:11:09,630 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-20 15:11:09,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-20 15:11:09,630 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-20 15:11:09,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-20 15:11:09,630 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-20 15:11:09,630 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-20 15:11:09,630 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-20 15:11:09,630 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 15:11:09,630 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-20 15:11:09,631 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-20 15:11:09,631 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 15:11:09,631 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-20 15:11:09,632 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-20 15:11:09,632 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-20 15:11:09,632 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 15:11:09,632 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-20 15:11:09,633 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-20 15:11:09,633 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-20 15:11:09,632 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-20 15:11:09,633 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37315,1689865822568' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-20 15:11:09,633 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41343,1689865822688' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-20 15:11:09,633 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-20 15:11:09,633 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46155,1689865822636' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-20 15:11:09,635 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 15:11:09,635 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:11:09,635 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 15:11:09,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:11:09,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:11:09,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:11:09,636 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:11:09,636 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 15:11:09,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:11:09,636 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 15:11:09,636 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 15:11:09,637 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 15:11:09,636 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 15:11:09,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:11:09,637 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 15:11:09,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-20 15:11:09,637 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 15:11:09,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:11:09,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:11:09,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:11:09,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:11:09,638 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41343,1689865822688' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-20 15:11:09,638 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@15052778[Count = 1] remaining members to acquire global barrier 2023-07-20 15:11:09,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:11:09,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:11:09,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:11:09,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:11:09,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:11:09,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-20 15:11:09,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:11:09,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:11:09,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:11:09,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:11:09,641 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46155,1689865822636' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-20 15:11:09,641 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@15052778[Count = 0] remaining members to acquire global barrier 2023-07-20 15:11:09,641 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-20 15:11:09,641 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 15:11:09,642 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 15:11:09,642 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 15:11:09,642 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 15:11:09,642 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 15:11:09,642 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 15:11:09,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 15:11:09,642 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 15:11:09,642 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-20 15:11:09,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 15:11:09,642 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-20 15:11:09,643 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-20 15:11:09,643 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,37315,1689865822568' in zk 2023-07-20 15:11:09,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 15:11:09,642 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:11:09,643 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-20 15:11:09,643 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 15:11:09,643 DEBUG [rs(jenkins-hbase4.apache.org,46155,1689865822636)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689865867770.b635363621057acdca183555341d1dce. 2023-07-20 15:11:09,643 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 15:11:09,643 DEBUG [rs(jenkins-hbase4.apache.org,46155,1689865822636)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689865867770.b635363621057acdca183555341d1dce. started... 2023-07-20 15:11:09,643 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 15:11:09,643 DEBUG [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689865867770.d01e46742a6b62293647bb83f9656d56. 2023-07-20 15:11:09,643 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:11:09,643 INFO [rs(jenkins-hbase4.apache.org,46155,1689865822636)-snapshot-pool-0] regionserver.HRegion(2745): Flushing b635363621057acdca183555341d1dce 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-20 15:11:09,643 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-20 15:11:09,643 DEBUG [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689865867770.d01e46742a6b62293647bb83f9656d56. started... 2023-07-20 15:11:09,643 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 15:11:09,644 INFO [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] regionserver.HRegion(2745): Flushing d01e46742a6b62293647bb83f9656d56 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-20 15:11:09,644 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-20 15:11:09,645 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 15:11:09,645 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-20 15:11:09,672 INFO [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230720f4d66f7075014faeaa4fd2b4863a6df1 to hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230720f4d66f7075014faeaa4fd2b4863a6df1 2023-07-20 15:11:09,672 INFO [rs(jenkins-hbase4.apache.org,46155,1689865822636)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307205cc5a730e9cb4c7c80262469c8043a4e to hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307205cc5a730e9cb4c7c80262469c8043a4e 2023-07-20 15:11:09,687 INFO [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testConsecutiveExports/d01e46742a6b62293647bb83f9656d56/.tmp/cf/365f8458d0eb455eb16270343dc95c99 2023-07-20 15:11:09,697 INFO [rs(jenkins-hbase4.apache.org,46155,1689865822636)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testConsecutiveExports/b635363621057acdca183555341d1dce/.tmp/cf/f12852485a7842fb82eb845ac4e1f55c 2023-07-20 15:11:09,697 DEBUG [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testConsecutiveExports/d01e46742a6b62293647bb83f9656d56/.tmp/cf/365f8458d0eb455eb16270343dc95c99 as hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testConsecutiveExports/d01e46742a6b62293647bb83f9656d56/cf/365f8458d0eb455eb16270343dc95c99 2023-07-20 15:11:09,703 INFO [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testConsecutiveExports/d01e46742a6b62293647bb83f9656d56/cf/365f8458d0eb455eb16270343dc95c99, entries=46, sequenceid=6, filesize=12.5 K 2023-07-20 15:11:09,704 DEBUG [rs(jenkins-hbase4.apache.org,46155,1689865822636)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testConsecutiveExports/b635363621057acdca183555341d1dce/.tmp/cf/f12852485a7842fb82eb845ac4e1f55c as hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testConsecutiveExports/b635363621057acdca183555341d1dce/cf/f12852485a7842fb82eb845ac4e1f55c 2023-07-20 15:11:09,704 INFO [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for d01e46742a6b62293647bb83f9656d56 in 61ms, sequenceid=6, compaction requested=false 2023-07-20 15:11:09,704 DEBUG [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-20 15:11:09,705 DEBUG [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d01e46742a6b62293647bb83f9656d56: 2023-07-20 15:11:09,705 DEBUG [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689865867770.d01e46742a6b62293647bb83f9656d56.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-20 15:11:09,705 DEBUG [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 15:11:09,705 DEBUG [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testConsecutiveExports/d01e46742a6b62293647bb83f9656d56/cf/365f8458d0eb455eb16270343dc95c99] hfiles 2023-07-20 15:11:09,705 DEBUG [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testConsecutiveExports/d01e46742a6b62293647bb83f9656d56/cf/365f8458d0eb455eb16270343dc95c99 for snapshot=snaptb0-testConsecutiveExports 2023-07-20 15:11:09,709 INFO [rs(jenkins-hbase4.apache.org,46155,1689865822636)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testConsecutiveExports/b635363621057acdca183555341d1dce/cf/f12852485a7842fb82eb845ac4e1f55c, entries=4, sequenceid=6, filesize=5.5 K 2023-07-20 15:11:09,710 INFO [rs(jenkins-hbase4.apache.org,46155,1689865822636)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for b635363621057acdca183555341d1dce in 67ms, sequenceid=6, compaction requested=false 2023-07-20 15:11:09,712 DEBUG [rs(jenkins-hbase4.apache.org,46155,1689865822636)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b635363621057acdca183555341d1dce: 2023-07-20 15:11:09,712 DEBUG [rs(jenkins-hbase4.apache.org,46155,1689865822636)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689865867770.b635363621057acdca183555341d1dce.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-20 15:11:09,712 DEBUG [rs(jenkins-hbase4.apache.org,46155,1689865822636)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 15:11:09,712 DEBUG [rs(jenkins-hbase4.apache.org,46155,1689865822636)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testConsecutiveExports/b635363621057acdca183555341d1dce/cf/f12852485a7842fb82eb845ac4e1f55c] hfiles 2023-07-20 15:11:09,712 DEBUG [Listener at jenkins-hbase4.apache.org/33267] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 15:11:09,712 DEBUG [rs(jenkins-hbase4.apache.org,46155,1689865822636)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testConsecutiveExports/b635363621057acdca183555341d1dce/cf/f12852485a7842fb82eb845ac4e1f55c for snapshot=snaptb0-testConsecutiveExports 2023-07-20 15:11:09,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-20 15:11:09,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-20 15:11:09,714 DEBUG [Listener at jenkins-hbase4.apache.org/33267] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-20 15:11:09,716 DEBUG [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689865867770.d01e46742a6b62293647bb83f9656d56. completed. 2023-07-20 15:11:09,716 DEBUG [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689865867770.d01e46742a6b62293647bb83f9656d56. 2023-07-20 15:11:09,716 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 15:11:09,716 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 15:11:09,716 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:11:09,716 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-20 15:11:09,716 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,41343,1689865822688' in zk 2023-07-20 15:11:09,718 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:11:09,718 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-20 15:11:09,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:11:09,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:11:09,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:11:09,718 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 15:11:09,718 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-20 15:11:09,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:11:09,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:11:09,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-20 15:11:09,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:11:09,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:11:09,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:11:09,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:11:09,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-20 15:11:09,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:11:09,723 DEBUG [rs(jenkins-hbase4.apache.org,46155,1689865822636)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689865867770.b635363621057acdca183555341d1dce. completed. 2023-07-20 15:11:09,724 DEBUG [rs(jenkins-hbase4.apache.org,46155,1689865822636)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689865867770.b635363621057acdca183555341d1dce. 2023-07-20 15:11:09,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:11:09,724 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 15:11:09,724 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 15:11:09,724 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:11:09,724 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-20 15:11:09,724 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,46155,1689865822636' in zk 2023-07-20 15:11:09,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,41343,1689865822688': 2023-07-20 15:11:09,725 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41343,1689865822688' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-20 15:11:09,726 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-20 15:11:09,726 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:11:09,726 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 15:11:09,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:11:09,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:11:09,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:11:09,727 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-20 15:11:09,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:11:09,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:11:09,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-20 15:11:09,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:11:09,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:11:09,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:11:09,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:11:09,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-20 15:11:09,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:11:09,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:11:09,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:11:09,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,46155,1689865822636': 2023-07-20 15:11:09,731 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46155,1689865822636' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-20 15:11:09,731 INFO [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-07-20 15:11:09,731 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-20 15:11:09,731 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-20 15:11:09,731 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-07-20 15:11:09,731 INFO [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-20 15:11:09,732 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 15:11:09,733 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 15:11:09,733 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 15:11:09,733 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 15:11:09,732 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 15:11:09,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 15:11:09,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 15:11:09,733 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:11:09,733 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:11:09,733 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 15:11:09,733 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 15:11:09,733 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:11:09,733 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:11:09,733 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:11:09,733 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:11:09,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:11:09,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 15:11:09,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 15:11:09,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:11:09,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:11:09,733 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:11:09,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:11:09,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 15:11:09,734 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:11:09,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:11:09,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 15:11:09,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:11:09,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 15:11:09,734 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:11:09,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-20 15:11:09,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:11:09,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-20 15:11:09,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:11:09,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:11:09,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:11:09,736 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:11:09,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:11:09,736 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:11:09,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-20 15:11:09,737 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:11:09,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:11:09,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:11:09,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:11:09,742 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:11:09,742 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:11:09,742 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:11:09,742 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:11:09,742 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:11:09,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:11:09,742 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:11:09,742 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:11:09,742 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:11:09,742 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-20 15:11:09,743 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-07-20 15:11:09,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:11:09,743 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-07-20 15:11:09,743 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:11:09,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:11:09,743 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:11:09,743 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:11:09,743 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:11:09,743 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 15:11:09,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:11:09,743 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:11:09,743 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-20 15:11:09,745 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-20 15:11:09,743 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:11:09,745 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:11:09,745 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-20 15:11:09,745 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 15:11:09,745 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:11:09,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:11:09,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:11:09,745 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:11:09,745 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:11:09,745 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 15:11:09,745 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 15:11:09,746 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230720f4d66f7075014faeaa4fd2b4863a6df1, hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307205cc5a730e9cb4c7c80262469c8043a4e] mob files 2023-07-20 15:11:09,746 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230720f4d66f7075014faeaa4fd2b4863a6df1 2023-07-20 15:11:09,746 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307205cc5a730e9cb4c7c80262469c8043a4e 2023-07-20 15:11:09,755 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-07-20 15:11:09,756 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-20 15:11:09,778 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-20 15:11:09,802 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-20 15:11:09,802 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-20 15:11:09,802 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-20 15:11:09,802 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689865869611Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1689865869755 (+144 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1689865869755Loading Region manifests for snaptb0-testConsecutiveExports at 1689865869755Writing data manifest for snaptb0-testConsecutiveExports at 1689865869762 (+7 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1689865869770 (+8 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689865869802 (+32 ms) 2023-07-20 15:11:09,805 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-20 15:11:09,807 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 193 msec 2023-07-20 15:11:09,914 DEBUG [Listener at jenkins-hbase4.apache.org/33267] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 15:11:09,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-20 15:11:09,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-20 15:11:09,916 INFO [Listener at jenkins-hbase4.apache.org/33267] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a3c136b5-559e-274b-8286-a02c66f74c8f/local-export-1689865869916 2023-07-20 15:11:09,916 INFO [Listener at jenkins-hbase4.apache.org/33267] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a3c136b5-559e-274b-8286-a02c66f74c8f/local-export-1689865869916, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a3c136b5-559e-274b-8286-a02c66f74c8f/local-export-1689865869916, srcFsUri=hdfs://localhost:42063, srcDir=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b 2023-07-20 15:11:09,939 DEBUG [Listener at jenkins-hbase4.apache.org/33267] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:42063, inputRoot=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b 2023-07-20 15:11:09,939 DEBUG [Listener at jenkins-hbase4.apache.org/33267] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@14f3459, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a3c136b5-559e-274b-8286-a02c66f74c8f/local-export-1689865869916, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a3c136b5-559e-274b-8286-a02c66f74c8f/local-export-1689865869916/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-20 15:11:09,939 INFO [Listener at jenkins-hbase4.apache.org/33267] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:42063, inputRoot=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b, snapshotDir=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-20 15:11:09,948 INFO [Listener at jenkins-hbase4.apache.org/33267] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a3c136b5-559e-274b-8286-a02c66f74c8f/local-export-1689865869916/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-20 15:11:09,960 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-20 15:11:09,961 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-20 15:11:09,961 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-20 15:11:09,961 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-20 15:11:09,962 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-20 15:11:09,962 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-20 15:11:09,962 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-20 15:11:10,031 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a3c136b5-559e-274b-8286-a02c66f74c8f/hadoop-856379673098481230.jar 2023-07-20 15:11:10,032 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-20 15:11:10,032 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-20 15:11:10,032 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-20 15:11:10,033 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-20 15:11:10,033 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-20 15:11:10,033 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-20 15:11:10,033 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-20 15:11:10,034 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-20 15:11:10,034 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-20 15:11:10,035 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-20 15:11:10,035 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-20 15:11:10,035 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-20 15:11:10,036 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-20 15:11:10,036 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-20 15:11:10,036 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-20 15:11:10,037 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-20 15:11:10,037 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 15:11:10,038 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 15:11:10,038 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 15:11:10,038 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 15:11:10,038 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 15:11:10,039 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 15:11:10,039 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 15:11:10,441 WARN [Listener at jenkins-hbase4.apache.org/33267] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-20 15:11:10,444 INFO [Listener at jenkins-hbase4.apache.org/33267] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-20 15:11:10,446 DEBUG [Listener at jenkins-hbase4.apache.org/33267] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-07-20 15:11:11,464 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-20 15:11:11,464 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-20 15:11:11,467 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689865830265_0002_000001 (auth:SIMPLE) 2023-07-20 15:11:12,269 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689865830265_0003_000001 (auth:SIMPLE) 2023-07-20 15:11:13,072 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-20 15:11:17,106 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689865830265_0003_000001 (auth:SIMPLE) 2023-07-20 15:11:19,414 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689865830265_0003_000001 (auth:SIMPLE) 2023-07-20 15:11:22,227 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689865830265_0003_000001 (auth:SIMPLE) 2023-07-20 15:11:23,633 INFO [Listener at jenkins-hbase4.apache.org/33267] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-20 15:11:23,634 INFO [Listener at jenkins-hbase4.apache.org/33267] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-20 15:11:23,641 INFO [Listener at jenkins-hbase4.apache.org/33267] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-20 15:11:23,641 INFO [Listener at jenkins-hbase4.apache.org/33267] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-20 15:11:23,642 INFO [Listener at jenkins-hbase4.apache.org/33267] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-20 15:11:23,642 DEBUG [Listener at jenkins-hbase4.apache.org/33267] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_478830040_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-20 15:11:23,644 DEBUG [Listener at jenkins-hbase4.apache.org/33267] snapshot.TestExportSnapshot(367): hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-20 15:11:23,644 DEBUG [Listener at jenkins-hbase4.apache.org/33267] snapshot.TestExportSnapshot(367): hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-20 15:11:23,645 DEBUG [Listener at jenkins-hbase4.apache.org/33267] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@430a8eed in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a3c136b5-559e-274b-8286-a02c66f74c8f/local-export-1689865869916/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a3c136b5-559e-274b-8286-a02c66f74c8f/local-export-1689865869916/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-20 15:11:23,645 DEBUG [Listener at jenkins-hbase4.apache.org/33267] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a3c136b5-559e-274b-8286-a02c66f74c8f/local-export-1689865869916/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-20 15:11:23,645 DEBUG [Listener at jenkins-hbase4.apache.org/33267] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a3c136b5-559e-274b-8286-a02c66f74c8f/local-export-1689865869916/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-20 15:11:23,646 INFO [Listener at jenkins-hbase4.apache.org/33267] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a3c136b5-559e-274b-8286-a02c66f74c8f/local-export-1689865869916, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a3c136b5-559e-274b-8286-a02c66f74c8f/local-export-1689865869916, srcFsUri=hdfs://localhost:42063, srcDir=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b 2023-07-20 15:11:23,672 DEBUG [Listener at jenkins-hbase4.apache.org/33267] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:42063, inputRoot=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b 2023-07-20 15:11:23,672 DEBUG [Listener at jenkins-hbase4.apache.org/33267] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@5c17a537, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a3c136b5-559e-274b-8286-a02c66f74c8f/local-export-1689865869916, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a3c136b5-559e-274b-8286-a02c66f74c8f/local-export-1689865869916/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-20 15:11:23,672 INFO [Listener at jenkins-hbase4.apache.org/33267] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:42063, inputRoot=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b, snapshotDir=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-20 15:11:23,684 INFO [Listener at jenkins-hbase4.apache.org/33267] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a3c136b5-559e-274b-8286-a02c66f74c8f/local-export-1689865869916/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-20 15:11:23,704 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-20 15:11:23,704 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-20 15:11:23,705 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-20 15:11:23,705 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-20 15:11:23,705 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-20 15:11:23,706 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-20 15:11:23,706 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-20 15:11:23,778 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a3c136b5-559e-274b-8286-a02c66f74c8f/hadoop-7332109436193900797.jar 2023-07-20 15:11:23,778 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-20 15:11:23,779 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-20 15:11:23,779 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-20 15:11:23,779 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-20 15:11:23,780 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-20 15:11:23,780 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-20 15:11:23,780 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-20 15:11:23,781 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-20 15:11:23,781 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-20 15:11:23,781 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-20 15:11:23,782 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-20 15:11:23,782 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-20 15:11:23,783 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-20 15:11:23,783 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-20 15:11:23,783 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-20 15:11:23,784 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-20 15:11:23,784 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 15:11:23,785 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 15:11:23,785 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 15:11:23,786 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 15:11:23,786 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 15:11:23,786 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 15:11:23,787 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 15:11:24,186 WARN [Listener at jenkins-hbase4.apache.org/33267] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-20 15:11:24,189 INFO [Listener at jenkins-hbase4.apache.org/33267] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-20 15:11:24,192 DEBUG [Listener at jenkins-hbase4.apache.org/33267] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-07-20 15:11:28,404 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-20 15:11:28,404 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-20 15:11:28,408 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689865830265_0003_000001 (auth:SIMPLE) 2023-07-20 15:11:28,481 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689865830265_0004_000001 (auth:SIMPLE) 2023-07-20 15:11:33,389 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689865830265_0004_000001 (auth:SIMPLE) 2023-07-20 15:11:35,673 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689865830265_0004_000001 (auth:SIMPLE) 2023-07-20 15:11:39,468 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689865830265_0004_000001 (auth:SIMPLE) 2023-07-20 15:11:41,451 INFO [Listener at jenkins-hbase4.apache.org/33267] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-20 15:11:41,452 INFO [Listener at jenkins-hbase4.apache.org/33267] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-20 15:11:41,456 INFO [Listener at jenkins-hbase4.apache.org/33267] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-20 15:11:41,456 INFO [Listener at jenkins-hbase4.apache.org/33267] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-20 15:11:41,456 INFO [Listener at jenkins-hbase4.apache.org/33267] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-20 15:11:41,456 DEBUG [Listener at jenkins-hbase4.apache.org/33267] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_478830040_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-20 15:11:41,460 DEBUG [Listener at jenkins-hbase4.apache.org/33267] snapshot.TestExportSnapshot(367): hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-20 15:11:41,460 DEBUG [Listener at jenkins-hbase4.apache.org/33267] snapshot.TestExportSnapshot(367): hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-20 15:11:41,460 DEBUG [Listener at jenkins-hbase4.apache.org/33267] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@430a8eed in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a3c136b5-559e-274b-8286-a02c66f74c8f/local-export-1689865869916/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a3c136b5-559e-274b-8286-a02c66f74c8f/local-export-1689865869916/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-20 15:11:41,460 DEBUG [Listener at jenkins-hbase4.apache.org/33267] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a3c136b5-559e-274b-8286-a02c66f74c8f/local-export-1689865869916/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-20 15:11:41,460 DEBUG [Listener at jenkins-hbase4.apache.org/33267] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a3c136b5-559e-274b-8286-a02c66f74c8f/local-export-1689865869916/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-20 15:11:41,478 INFO [Listener at jenkins-hbase4.apache.org/33267] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-07-20 15:11:41,479 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-07-20 15:11:41,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] procedure2.ProcedureExecutor(1029): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-07-20 15:11:41,485 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689865901485"}]},"ts":"1689865901485"} 2023-07-20 15:11:41,485 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-20 15:11:41,492 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-07-20 15:11:41,494 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-07-20 15:11:41,499 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=b635363621057acdca183555341d1dce, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=d01e46742a6b62293647bb83f9656d56, UNASSIGN}] 2023-07-20 15:11:41,500 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=d01e46742a6b62293647bb83f9656d56, UNASSIGN 2023-07-20 15:11:41,508 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=b635363621057acdca183555341d1dce, UNASSIGN 2023-07-20 15:11:41,510 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=d01e46742a6b62293647bb83f9656d56, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:11:41,510 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=b635363621057acdca183555341d1dce, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:11:41,510 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689865867770.d01e46742a6b62293647bb83f9656d56.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689865901510"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689865901510"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689865901510"}]},"ts":"1689865901510"} 2023-07-20 15:11:41,510 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689865867770.b635363621057acdca183555341d1dce.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689865901510"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689865901510"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689865901510"}]},"ts":"1689865901510"} 2023-07-20 15:11:41,520 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=53, state=RUNNABLE; CloseRegionProcedure d01e46742a6b62293647bb83f9656d56, server=jenkins-hbase4.apache.org,41343,1689865822688}] 2023-07-20 15:11:41,522 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=52, state=RUNNABLE; CloseRegionProcedure b635363621057acdca183555341d1dce, server=jenkins-hbase4.apache.org,46155,1689865822636}] 2023-07-20 15:11:41,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-20 15:11:41,674 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close d01e46742a6b62293647bb83f9656d56 2023-07-20 15:11:41,674 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d01e46742a6b62293647bb83f9656d56, disabling compactions & flushes 2023-07-20 15:11:41,674 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689865867770.d01e46742a6b62293647bb83f9656d56. 2023-07-20 15:11:41,674 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689865867770.d01e46742a6b62293647bb83f9656d56. 2023-07-20 15:11:41,674 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689865867770.d01e46742a6b62293647bb83f9656d56. after waiting 0 ms 2023-07-20 15:11:41,674 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689865867770.d01e46742a6b62293647bb83f9656d56. 2023-07-20 15:11:41,675 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close b635363621057acdca183555341d1dce 2023-07-20 15:11:41,675 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b635363621057acdca183555341d1dce, disabling compactions & flushes 2023-07-20 15:11:41,675 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689865867770.b635363621057acdca183555341d1dce. 2023-07-20 15:11:41,675 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689865867770.b635363621057acdca183555341d1dce. 2023-07-20 15:11:41,679 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689865867770.b635363621057acdca183555341d1dce. after waiting 0 ms 2023-07-20 15:11:41,679 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689865867770.b635363621057acdca183555341d1dce. 2023-07-20 15:11:41,692 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testConsecutiveExports/d01e46742a6b62293647bb83f9656d56/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-20 15:11:41,693 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 15:11:41,695 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689865867770.d01e46742a6b62293647bb83f9656d56. 2023-07-20 15:11:41,695 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d01e46742a6b62293647bb83f9656d56: 2023-07-20 15:11:41,696 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testConsecutiveExports/b635363621057acdca183555341d1dce/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-20 15:11:41,696 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 15:11:41,698 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689865867770.b635363621057acdca183555341d1dce. 2023-07-20 15:11:41,698 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b635363621057acdca183555341d1dce: 2023-07-20 15:11:41,698 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed d01e46742a6b62293647bb83f9656d56 2023-07-20 15:11:41,699 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=d01e46742a6b62293647bb83f9656d56, regionState=CLOSED 2023-07-20 15:11:41,699 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689865867770.d01e46742a6b62293647bb83f9656d56.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689865901699"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689865901699"}]},"ts":"1689865901699"} 2023-07-20 15:11:41,700 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed b635363621057acdca183555341d1dce 2023-07-20 15:11:41,701 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=b635363621057acdca183555341d1dce, regionState=CLOSED 2023-07-20 15:11:41,701 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689865867770.b635363621057acdca183555341d1dce.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689865901701"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689865901701"}]},"ts":"1689865901701"} 2023-07-20 15:11:41,704 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=53 2023-07-20 15:11:41,704 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=53, state=SUCCESS; CloseRegionProcedure d01e46742a6b62293647bb83f9656d56, server=jenkins-hbase4.apache.org,41343,1689865822688 in 181 msec 2023-07-20 15:11:41,706 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=d01e46742a6b62293647bb83f9656d56, UNASSIGN in 205 msec 2023-07-20 15:11:41,706 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=52 2023-07-20 15:11:41,706 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=52, state=SUCCESS; CloseRegionProcedure b635363621057acdca183555341d1dce, server=jenkins-hbase4.apache.org,46155,1689865822636 in 181 msec 2023-07-20 15:11:41,708 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=51 2023-07-20 15:11:41,708 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=b635363621057acdca183555341d1dce, UNASSIGN in 207 msec 2023-07-20 15:11:41,708 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689865901708"}]},"ts":"1689865901708"} 2023-07-20 15:11:41,711 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-07-20 15:11:41,713 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-07-20 15:11:41,716 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 235 msec 2023-07-20 15:11:41,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-20 15:11:41,790 INFO [Listener at jenkins-hbase4.apache.org/33267] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-07-20 15:11:41,791 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-07-20 15:11:41,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] procedure2.ProcedureExecutor(1029): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-20 15:11:41,798 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-20 15:11:41,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-07-20 15:11:41,801 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41343] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-07-20 15:11:41,805 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-20 15:11:41,805 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-20 15:11:41,805 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-20 15:11:41,805 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-20 15:11:41,805 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-20 15:11:41,806 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-20 15:11:41,806 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-20 15:11:41,809 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-20 15:11:41,809 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-20 15:11:41,811 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-20 15:11:41,811 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 15:11:41,811 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-20 15:11:41,811 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 15:11:41,811 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-20 15:11:41,811 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 15:11:41,811 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-20 15:11:41,812 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 15:11:41,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-20 15:11:41,819 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testConsecutiveExports/b635363621057acdca183555341d1dce 2023-07-20 15:11:41,834 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testConsecutiveExports/d01e46742a6b62293647bb83f9656d56 2023-07-20 15:11:41,836 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testConsecutiveExports/b635363621057acdca183555341d1dce/cf, FileablePath, hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testConsecutiveExports/b635363621057acdca183555341d1dce/recovered.edits] 2023-07-20 15:11:41,837 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testConsecutiveExports/d01e46742a6b62293647bb83f9656d56/cf, FileablePath, hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testConsecutiveExports/d01e46742a6b62293647bb83f9656d56/recovered.edits] 2023-07-20 15:11:41,843 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testConsecutiveExports/d01e46742a6b62293647bb83f9656d56/cf/365f8458d0eb455eb16270343dc95c99 to hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/archive/data/default/testtb-testConsecutiveExports/d01e46742a6b62293647bb83f9656d56/cf/365f8458d0eb455eb16270343dc95c99 2023-07-20 15:11:41,856 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testConsecutiveExports/d01e46742a6b62293647bb83f9656d56/recovered.edits/9.seqid to hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/archive/data/default/testtb-testConsecutiveExports/d01e46742a6b62293647bb83f9656d56/recovered.edits/9.seqid 2023-07-20 15:11:41,857 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testConsecutiveExports/d01e46742a6b62293647bb83f9656d56 2023-07-20 15:11:41,858 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testConsecutiveExports/b635363621057acdca183555341d1dce/cf/f12852485a7842fb82eb845ac4e1f55c to hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/archive/data/default/testtb-testConsecutiveExports/b635363621057acdca183555341d1dce/cf/f12852485a7842fb82eb845ac4e1f55c 2023-07-20 15:11:41,862 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testConsecutiveExports/b635363621057acdca183555341d1dce/recovered.edits/9.seqid to hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/archive/data/default/testtb-testConsecutiveExports/b635363621057acdca183555341d1dce/recovered.edits/9.seqid 2023-07-20 15:11:41,863 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testConsecutiveExports/b635363621057acdca183555341d1dce 2023-07-20 15:11:41,863 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-20 15:11:41,864 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-07-20 15:11:41,865 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-07-20 15:11:41,869 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230720f4d66f7075014faeaa4fd2b4863a6df1 to hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230720f4d66f7075014faeaa4fd2b4863a6df1 2023-07-20 15:11:41,871 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307205cc5a730e9cb4c7c80262469c8043a4e to hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307205cc5a730e9cb4c7c80262469c8043a4e 2023-07-20 15:11:41,871 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-07-20 15:11:41,874 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-20 15:11:41,882 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-07-20 15:11:41,886 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-07-20 15:11:41,890 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-20 15:11:41,890 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-07-20 15:11:41,890 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1689865867770.b635363621057acdca183555341d1dce.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689865901890"}]},"ts":"9223372036854775807"} 2023-07-20 15:11:41,890 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1689865867770.d01e46742a6b62293647bb83f9656d56.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689865901890"}]},"ts":"9223372036854775807"} 2023-07-20 15:11:41,892 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-20 15:11:41,892 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => b635363621057acdca183555341d1dce, NAME => 'testtb-testConsecutiveExports,,1689865867770.b635363621057acdca183555341d1dce.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => d01e46742a6b62293647bb83f9656d56, NAME => 'testtb-testConsecutiveExports,1,1689865867770.d01e46742a6b62293647bb83f9656d56.', STARTKEY => '1', ENDKEY => ''}] 2023-07-20 15:11:41,893 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-07-20 15:11:41,893 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689865901893"}]},"ts":"9223372036854775807"} 2023-07-20 15:11:41,895 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-07-20 15:11:41,899 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-20 15:11:41,902 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 108 msec 2023-07-20 15:11:41,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-20 15:11:41,913 INFO [Listener at jenkins-hbase4.apache.org/33267] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-07-20 15:11:41,939 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-07-20 15:11:41,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:41,954 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-07-20 15:11:41,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-07-20 15:11:41,996 INFO [Listener at jenkins-hbase4.apache.org/33267] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=744 (was 761), OpenFileDescriptor=894 (was 932), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=434 (was 358) - SystemLoadAverage LEAK? -, ProcessCount=185 (was 183) - ProcessCount LEAK? -, AvailableMemoryMB=2897 (was 3100) 2023-07-20 15:11:41,997 WARN [Listener at jenkins-hbase4.apache.org/33267] hbase.ResourceChecker(130): Thread=744 is superior to 500 2023-07-20 15:11:42,033 INFO [Listener at jenkins-hbase4.apache.org/33267] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=744, OpenFileDescriptor=896, MaxFileDescriptor=60000, SystemLoadAverage=434, ProcessCount=185, AvailableMemoryMB=2894 2023-07-20 15:11:42,033 WARN [Listener at jenkins-hbase4.apache.org/33267] hbase.ResourceChecker(130): Thread=744 is superior to 500 2023-07-20 15:11:42,037 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-20 15:11:42,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] procedure2.ProcedureExecutor(1029): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,050 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-07-20 15:11:42,050 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-07-20 15:11:42,051 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-20 15:11:42,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-20 15:11:42,062 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c902fc21d635ffa07c05b0f13fefb29b 2023-07-20 15:11:42,062 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9ed4601cb0f85ae18e43b33ef9413cf5 2023-07-20 15:11:42,063 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c902fc21d635ffa07c05b0f13fefb29b empty. 2023-07-20 15:11:42,063 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9ed4601cb0f85ae18e43b33ef9413cf5 empty. 2023-07-20 15:11:42,064 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9ed4601cb0f85ae18e43b33ef9413cf5 2023-07-20 15:11:42,064 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c902fc21d635ffa07c05b0f13fefb29b 2023-07-20 15:11:42,064 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-20 15:11:42,128 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-07-20 15:11:42,131 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => c902fc21d635ffa07c05b0f13fefb29b, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689865902037.c902fc21d635ffa07c05b0f13fefb29b.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp 2023-07-20 15:11:42,135 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 9ed4601cb0f85ae18e43b33ef9413cf5, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689865902037.9ed4601cb0f85ae18e43b33ef9413cf5.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp 2023-07-20 15:11:42,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-20 15:11:42,170 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689865902037.c902fc21d635ffa07c05b0f13fefb29b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 15:11:42,170 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing c902fc21d635ffa07c05b0f13fefb29b, disabling compactions & flushes 2023-07-20 15:11:42,170 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689865902037.c902fc21d635ffa07c05b0f13fefb29b. 2023-07-20 15:11:42,170 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689865902037.c902fc21d635ffa07c05b0f13fefb29b. 2023-07-20 15:11:42,170 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689865902037.c902fc21d635ffa07c05b0f13fefb29b. after waiting 0 ms 2023-07-20 15:11:42,170 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689865902037.c902fc21d635ffa07c05b0f13fefb29b. 2023-07-20 15:11:42,170 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689865902037.c902fc21d635ffa07c05b0f13fefb29b. 2023-07-20 15:11:42,170 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for c902fc21d635ffa07c05b0f13fefb29b: 2023-07-20 15:11:42,208 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689865902037.9ed4601cb0f85ae18e43b33ef9413cf5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 15:11:42,208 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 9ed4601cb0f85ae18e43b33ef9413cf5, disabling compactions & flushes 2023-07-20 15:11:42,208 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689865902037.9ed4601cb0f85ae18e43b33ef9413cf5. 2023-07-20 15:11:42,208 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689865902037.9ed4601cb0f85ae18e43b33ef9413cf5. 2023-07-20 15:11:42,208 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689865902037.9ed4601cb0f85ae18e43b33ef9413cf5. after waiting 0 ms 2023-07-20 15:11:42,208 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689865902037.9ed4601cb0f85ae18e43b33ef9413cf5. 2023-07-20 15:11:42,208 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689865902037.9ed4601cb0f85ae18e43b33ef9413cf5. 2023-07-20 15:11:42,208 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 9ed4601cb0f85ae18e43b33ef9413cf5: 2023-07-20 15:11:42,211 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-07-20 15:11:42,213 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689865902037.c902fc21d635ffa07c05b0f13fefb29b.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689865902212"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689865902212"}]},"ts":"1689865902212"} 2023-07-20 15:11:42,213 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689865902037.9ed4601cb0f85ae18e43b33ef9413cf5.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689865902212"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689865902212"}]},"ts":"1689865902212"} 2023-07-20 15:11:42,220 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-20 15:11:42,222 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-20 15:11:42,222 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689865902222"}]},"ts":"1689865902222"} 2023-07-20 15:11:42,223 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-07-20 15:11:42,229 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-20 15:11:42,230 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-20 15:11:42,230 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-20 15:11:42,230 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-20 15:11:42,230 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-20 15:11:42,231 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c902fc21d635ffa07c05b0f13fefb29b, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=9ed4601cb0f85ae18e43b33ef9413cf5, ASSIGN}] 2023-07-20 15:11:42,234 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=9ed4601cb0f85ae18e43b33ef9413cf5, ASSIGN 2023-07-20 15:11:42,234 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c902fc21d635ffa07c05b0f13fefb29b, ASSIGN 2023-07-20 15:11:42,235 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=9ed4601cb0f85ae18e43b33ef9413cf5, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46155,1689865822636; forceNewPlan=false, retain=false 2023-07-20 15:11:42,235 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c902fc21d635ffa07c05b0f13fefb29b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41343,1689865822688; forceNewPlan=false, retain=false 2023-07-20 15:11:42,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-20 15:11:42,386 INFO [jenkins-hbase4:38949] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-20 15:11:42,389 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=c902fc21d635ffa07c05b0f13fefb29b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:11:42,389 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=9ed4601cb0f85ae18e43b33ef9413cf5, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:11:42,389 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689865902037.c902fc21d635ffa07c05b0f13fefb29b.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689865902389"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689865902389"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689865902389"}]},"ts":"1689865902389"} 2023-07-20 15:11:42,390 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689865902037.9ed4601cb0f85ae18e43b33ef9413cf5.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689865902389"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689865902389"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689865902389"}]},"ts":"1689865902389"} 2023-07-20 15:11:42,397 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=58, state=RUNNABLE; OpenRegionProcedure c902fc21d635ffa07c05b0f13fefb29b, server=jenkins-hbase4.apache.org,41343,1689865822688}] 2023-07-20 15:11:42,398 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=59, state=RUNNABLE; OpenRegionProcedure 9ed4601cb0f85ae18e43b33ef9413cf5, server=jenkins-hbase4.apache.org,46155,1689865822636}] 2023-07-20 15:11:42,554 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1689865902037.9ed4601cb0f85ae18e43b33ef9413cf5. 2023-07-20 15:11:42,555 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9ed4601cb0f85ae18e43b33ef9413cf5, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689865902037.9ed4601cb0f85ae18e43b33ef9413cf5.', STARTKEY => '1', ENDKEY => ''} 2023-07-20 15:11:42,555 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1689865902037.9ed4601cb0f85ae18e43b33ef9413cf5. service=AccessControlService 2023-07-20 15:11:42,555 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1689865902037.c902fc21d635ffa07c05b0f13fefb29b. 2023-07-20 15:11:42,555 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 15:11:42,555 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c902fc21d635ffa07c05b0f13fefb29b, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689865902037.c902fc21d635ffa07c05b0f13fefb29b.', STARTKEY => '', ENDKEY => '1'} 2023-07-20 15:11:42,555 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 9ed4601cb0f85ae18e43b33ef9413cf5 2023-07-20 15:11:42,556 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689865902037.9ed4601cb0f85ae18e43b33ef9413cf5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 15:11:42,556 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1689865902037.c902fc21d635ffa07c05b0f13fefb29b. service=AccessControlService 2023-07-20 15:11:42,556 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 9ed4601cb0f85ae18e43b33ef9413cf5 2023-07-20 15:11:42,556 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 9ed4601cb0f85ae18e43b33ef9413cf5 2023-07-20 15:11:42,556 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 15:11:42,556 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion c902fc21d635ffa07c05b0f13fefb29b 2023-07-20 15:11:42,556 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689865902037.c902fc21d635ffa07c05b0f13fefb29b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 15:11:42,556 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c902fc21d635ffa07c05b0f13fefb29b 2023-07-20 15:11:42,556 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c902fc21d635ffa07c05b0f13fefb29b 2023-07-20 15:11:42,557 INFO [StoreOpener-9ed4601cb0f85ae18e43b33ef9413cf5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 9ed4601cb0f85ae18e43b33ef9413cf5 2023-07-20 15:11:42,557 INFO [StoreOpener-c902fc21d635ffa07c05b0f13fefb29b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region c902fc21d635ffa07c05b0f13fefb29b 2023-07-20 15:11:42,559 DEBUG [StoreOpener-9ed4601cb0f85ae18e43b33ef9413cf5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportFileSystemStateWithMergeRegion/9ed4601cb0f85ae18e43b33ef9413cf5/cf 2023-07-20 15:11:42,559 DEBUG [StoreOpener-c902fc21d635ffa07c05b0f13fefb29b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportFileSystemStateWithMergeRegion/c902fc21d635ffa07c05b0f13fefb29b/cf 2023-07-20 15:11:42,559 DEBUG [StoreOpener-c902fc21d635ffa07c05b0f13fefb29b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportFileSystemStateWithMergeRegion/c902fc21d635ffa07c05b0f13fefb29b/cf 2023-07-20 15:11:42,559 DEBUG [StoreOpener-9ed4601cb0f85ae18e43b33ef9413cf5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportFileSystemStateWithMergeRegion/9ed4601cb0f85ae18e43b33ef9413cf5/cf 2023-07-20 15:11:42,560 INFO [StoreOpener-9ed4601cb0f85ae18e43b33ef9413cf5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9ed4601cb0f85ae18e43b33ef9413cf5 columnFamilyName cf 2023-07-20 15:11:42,560 INFO [StoreOpener-c902fc21d635ffa07c05b0f13fefb29b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c902fc21d635ffa07c05b0f13fefb29b columnFamilyName cf 2023-07-20 15:11:42,562 INFO [StoreOpener-c902fc21d635ffa07c05b0f13fefb29b-1] regionserver.HStore(310): Store=c902fc21d635ffa07c05b0f13fefb29b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 15:11:42,563 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportFileSystemStateWithMergeRegion/c902fc21d635ffa07c05b0f13fefb29b 2023-07-20 15:11:42,564 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportFileSystemStateWithMergeRegion/c902fc21d635ffa07c05b0f13fefb29b 2023-07-20 15:11:42,567 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c902fc21d635ffa07c05b0f13fefb29b 2023-07-20 15:11:42,567 INFO [StoreOpener-9ed4601cb0f85ae18e43b33ef9413cf5-1] regionserver.HStore(310): Store=9ed4601cb0f85ae18e43b33ef9413cf5/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 15:11:42,568 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportFileSystemStateWithMergeRegion/9ed4601cb0f85ae18e43b33ef9413cf5 2023-07-20 15:11:42,569 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportFileSystemStateWithMergeRegion/9ed4601cb0f85ae18e43b33ef9413cf5 2023-07-20 15:11:42,569 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportFileSystemStateWithMergeRegion/c902fc21d635ffa07c05b0f13fefb29b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 15:11:42,570 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c902fc21d635ffa07c05b0f13fefb29b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74410277, jitterRate=0.1087995320558548}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 15:11:42,570 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c902fc21d635ffa07c05b0f13fefb29b: 2023-07-20 15:11:42,572 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1689865902037.c902fc21d635ffa07c05b0f13fefb29b., pid=60, masterSystemTime=1689865902551 2023-07-20 15:11:42,573 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 9ed4601cb0f85ae18e43b33ef9413cf5 2023-07-20 15:11:42,573 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1689865902037.c902fc21d635ffa07c05b0f13fefb29b. 2023-07-20 15:11:42,573 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1689865902037.c902fc21d635ffa07c05b0f13fefb29b. 2023-07-20 15:11:42,575 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=c902fc21d635ffa07c05b0f13fefb29b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:11:42,575 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689865902037.c902fc21d635ffa07c05b0f13fefb29b.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689865902575"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689865902575"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689865902575"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689865902575"}]},"ts":"1689865902575"} 2023-07-20 15:11:42,579 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=58 2023-07-20 15:11:42,579 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=58, state=SUCCESS; OpenRegionProcedure c902fc21d635ffa07c05b0f13fefb29b, server=jenkins-hbase4.apache.org,41343,1689865822688 in 180 msec 2023-07-20 15:11:42,580 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c902fc21d635ffa07c05b0f13fefb29b, ASSIGN in 348 msec 2023-07-20 15:11:42,589 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportFileSystemStateWithMergeRegion/9ed4601cb0f85ae18e43b33ef9413cf5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 15:11:42,590 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 9ed4601cb0f85ae18e43b33ef9413cf5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69510797, jitterRate=0.03579159080982208}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 15:11:42,590 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 9ed4601cb0f85ae18e43b33ef9413cf5: 2023-07-20 15:11:42,595 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1689865902037.9ed4601cb0f85ae18e43b33ef9413cf5., pid=61, masterSystemTime=1689865902551 2023-07-20 15:11:42,597 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1689865902037.9ed4601cb0f85ae18e43b33ef9413cf5. 2023-07-20 15:11:42,597 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1689865902037.9ed4601cb0f85ae18e43b33ef9413cf5. 2023-07-20 15:11:42,598 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=9ed4601cb0f85ae18e43b33ef9413cf5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:11:42,598 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689865902037.9ed4601cb0f85ae18e43b33ef9413cf5.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689865902597"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689865902597"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689865902597"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689865902597"}]},"ts":"1689865902597"} 2023-07-20 15:11:42,602 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=59 2023-07-20 15:11:42,603 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=59, state=SUCCESS; OpenRegionProcedure 9ed4601cb0f85ae18e43b33ef9413cf5, server=jenkins-hbase4.apache.org,46155,1689865822636 in 201 msec 2023-07-20 15:11:42,607 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=59, resume processing ppid=57 2023-07-20 15:11:42,607 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=9ed4601cb0f85ae18e43b33ef9413cf5, ASSIGN in 372 msec 2023-07-20 15:11:42,608 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-20 15:11:42,608 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689865902608"}]},"ts":"1689865902608"} 2023-07-20 15:11:42,611 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-07-20 15:11:42,613 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-07-20 15:11:42,614 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-07-20 15:11:42,616 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41343] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-20 15:11:42,618 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 15:11:42,618 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 15:11:42,618 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 15:11:42,618 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 15:11:42,621 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-20 15:11:42,621 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-20 15:11:42,621 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-20 15:11:42,621 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-20 15:11:42,627 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 584 msec 2023-07-20 15:11:42,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-20 15:11:42,658 INFO [Listener at jenkins-hbase4.apache.org/33267] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-07-20 15:11:42,660 DEBUG [Listener at jenkins-hbase4.apache.org/33267] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,660 DEBUG [Listener at jenkins-hbase4.apache.org/33267] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689865902037.c902fc21d635ffa07c05b0f13fefb29b. 2023-07-20 15:11:42,662 INFO [Listener at jenkins-hbase4.apache.org/33267] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-20 15:11:42,686 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-20 15:11:42,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689865902686 (current time:1689865902686). 2023-07-20 15:11:42,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-20 15:11:42,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] zookeeper.ReadOnlyZKClient(139): Connect 0x0c8d2135 to 127.0.0.1:64446 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 15:11:42,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@12a8b7d0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 15:11:42,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 15:11:42,710 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51926, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 15:11:42,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0c8d2135 to 127.0.0.1:64446 2023-07-20 15:11:42,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 15:11:42,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] zookeeper.ReadOnlyZKClient(139): Connect 0x3c439a3d to 127.0.0.1:64446 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 15:11:42,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@59a28009, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 15:11:42,752 DEBUG [hconnection-0xee3bada-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 15:11:42,753 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51938, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 15:11:42,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 15:11:42,761 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39626, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 15:11:42,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3c439a3d to 127.0.0.1:64446 2023-07-20 15:11:42,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 15:11:42,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-20 15:11:42,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-20 15:11:42,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-20 15:11:42,767 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-20 15:11:42,768 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-20 15:11:42,768 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689866502768 2023-07-20 15:11:42,768 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-20 15:11:42,768 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,769 DEBUG [Listener at jenkins-hbase4.apache.org/33267] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-20 15:11:42,770 DEBUG [Listener at jenkins-hbase4.apache.org/33267] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-20 15:11:42,770 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-20 15:11:42,771 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-20 15:11:42,773 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 5 msec 2023-07-20 15:11:42,774 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-20 15:11:42,782 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689866502782 2023-07-20 15:11:42,801 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,801 INFO [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-20 15:11:42,801 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 15:11:42,803 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-20 15:11:42,803 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-20 15:11:42,803 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,803 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,805 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:11:42,805 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:11:42,805 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:11:42,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:11:42,805 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:11:42,805 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:11:42,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:11:42,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,805 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:11:42,805 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:11:42,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,805 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:11:42,805 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:11:42,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:11:42,806 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,806 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:11:42,806 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-20 15:11:42,806 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,807 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-20 15:11:42,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,807 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-20 15:11:42,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-20 15:11:42,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,808 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-20 15:11:42,809 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,809 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,809 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-20 15:11:42,809 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-20 15:11:42,809 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 15:11:42,809 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 15:11:42,811 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-20 15:11:42,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-20 15:11:42,812 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-20 15:11:42,812 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-20 15:11:42,812 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-20 15:11:42,813 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37315,1689865822568' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-20 15:11:42,812 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41343,1689865822688' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-20 15:11:42,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,813 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-20 15:11:42,813 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,813 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-20 15:11:42,813 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 15:11:42,814 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-20 15:11:42,814 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-20 15:11:42,814 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46155,1689865822636' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-20 15:11:42,815 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,815 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:11:42,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:11:42,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:11:42,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:11:42,815 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,815 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 15:11:42,815 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,820 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,820 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:11:42,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:11:42,820 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,820 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 15:11:42,820 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,820 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 15:11:42,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:11:42,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:11:42,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:11:42,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:11:42,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:11:42,822 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41343,1689865822688' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-20 15:11:42,822 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@56277c31[Count = 1] remaining members to acquire global barrier 2023-07-20 15:11:42,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:11:42,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:11:42,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:11:42,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:11:42,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:11:42,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:11:42,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:11:42,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:11:42,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:11:42,825 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46155,1689865822636' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-20 15:11:42,825 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@56277c31[Count = 0] remaining members to acquire global barrier 2023-07-20 15:11:42,825 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-20 15:11:42,825 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,834 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,834 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,834 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,834 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,834 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,834 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:11:42,834 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,834 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-20 15:11:42,834 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-20 15:11:42,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,835 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-20 15:11:42,835 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-20 15:11:42,835 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,37315,1689865822568' in zk 2023-07-20 15:11:42,835 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 15:11:42,835 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 15:11:42,835 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 15:11:42,835 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 15:11:42,835 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:11:42,835 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-20 15:11:42,835 DEBUG [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689865902037.c902fc21d635ffa07c05b0f13fefb29b. 2023-07-20 15:11:42,835 DEBUG [rs(jenkins-hbase4.apache.org,46155,1689865822636)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689865902037.9ed4601cb0f85ae18e43b33ef9413cf5. 2023-07-20 15:11:42,836 DEBUG [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689865902037.c902fc21d635ffa07c05b0f13fefb29b. started... 2023-07-20 15:11:42,836 DEBUG [rs(jenkins-hbase4.apache.org,46155,1689865822636)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689865902037.9ed4601cb0f85ae18e43b33ef9413cf5. started... 2023-07-20 15:11:42,837 DEBUG [rs(jenkins-hbase4.apache.org,46155,1689865822636)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9ed4601cb0f85ae18e43b33ef9413cf5: 2023-07-20 15:11:42,837 DEBUG [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c902fc21d635ffa07c05b0f13fefb29b: 2023-07-20 15:11:42,837 DEBUG [rs(jenkins-hbase4.apache.org,46155,1689865822636)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689865902037.9ed4601cb0f85ae18e43b33ef9413cf5.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,837 DEBUG [rs(jenkins-hbase4.apache.org,46155,1689865822636)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 15:11:42,838 DEBUG [rs(jenkins-hbase4.apache.org,46155,1689865822636)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-20 15:11:42,838 DEBUG [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689865902037.c902fc21d635ffa07c05b0f13fefb29b.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,838 DEBUG [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 15:11:42,838 DEBUG [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-20 15:11:42,868 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-20 15:11:42,871 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 15:11:42,871 DEBUG [Listener at jenkins-hbase4.apache.org/33267] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 15:11:42,871 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-20 15:11:42,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-20 15:11:42,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-20 15:11:42,873 DEBUG [rs(jenkins-hbase4.apache.org,46155,1689865822636)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689865902037.9ed4601cb0f85ae18e43b33ef9413cf5. completed. 2023-07-20 15:11:42,873 DEBUG [rs(jenkins-hbase4.apache.org,46155,1689865822636)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689865902037.9ed4601cb0f85ae18e43b33ef9413cf5. 2023-07-20 15:11:42,873 DEBUG [Listener at jenkins-hbase4.apache.org/33267] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-20 15:11:42,873 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 15:11:42,874 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 15:11:42,874 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:11:42,874 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-20 15:11:42,874 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,46155,1689865822636' in zk 2023-07-20 15:11:42,896 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:11:42,896 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-20 15:11:42,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:11:42,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:11:42,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:11:42,896 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 15:11:42,896 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-20 15:11:42,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:11:42,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:11:42,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:11:42,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:11:42,901 DEBUG [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689865902037.c902fc21d635ffa07c05b0f13fefb29b. completed. 2023-07-20 15:11:42,901 DEBUG [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689865902037.c902fc21d635ffa07c05b0f13fefb29b. 2023-07-20 15:11:42,901 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 15:11:42,901 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 15:11:42,901 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:11:42,901 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-20 15:11:42,901 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,41343,1689865822688' in zk 2023-07-20 15:11:42,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:11:42,919 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-20 15:11:42,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:11:42,919 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 15:11:42,919 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:11:42,919 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-20 15:11:42,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:11:42,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:11:42,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:11:42,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,46155,1689865822636': 2023-07-20 15:11:42,923 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46155,1689865822636' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-20 15:11:42,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:11:42,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:11:42,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:11:42,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:11:42,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:11:42,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:11:42,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:11:42,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:11:42,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:11:42,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:11:42,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:11:42,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:11:42,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,41343,1689865822688': 2023-07-20 15:11:42,927 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41343,1689865822688' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-20 15:11:42,927 INFO [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-20 15:11:42,927 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-20 15:11:42,927 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-20 15:11:42,927 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,927 INFO [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-20 15:11:42,934 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,934 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,934 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:11:42,934 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,934 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,935 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:11:42,935 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,934 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,935 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:11:42,935 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,935 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:11:42,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:11:42,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:11:42,935 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:11:42,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:11:42,935 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:11:42,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,935 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:11:42,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:11:42,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:11:42,936 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:11:42,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:11:42,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,936 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:11:42,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:11:42,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:11:42,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:11:42,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:11:42,938 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:11:42,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:11:42,939 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:11:42,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,939 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:11:42,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:11:42,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:11:42,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:11:42,965 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:11:42,965 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,965 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:11:42,965 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:11:42,965 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:11:42,965 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:11:42,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:11:42,965 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:11:42,965 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,965 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:11:42,966 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,966 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:11:42,966 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 15:11:42,966 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:11:42,966 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,966 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:11:42,966 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:11:42,966 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,966 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,966 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,966 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-20 15:11:42,967 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-20 15:11:42,970 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:11:42,970 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:11:42,970 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:11:42,970 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:11:42,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:11:42,970 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:11:42,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:11:42,970 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:11:42,975 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:11:42,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:11:42,975 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:11:42,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:11:43,003 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:43,008 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:43,057 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:43,074 DEBUG [Listener at jenkins-hbase4.apache.org/33267] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 15:11:43,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-20 15:11:43,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-20 15:11:43,076 DEBUG [Listener at jenkins-hbase4.apache.org/33267] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-20 15:11:43,111 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-20 15:11:43,111 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:43,112 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:43,112 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689865902769Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1689865903003 (+234 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689865903003Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689865903004 (+1 ms)Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689865903015 (+11 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689865903047 (+32 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689865903111 (+64 ms) 2023-07-20 15:11:43,115 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-20 15:11:43,119 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 346 msec 2023-07-20 15:11:43,171 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-20 15:11:43,376 DEBUG [Listener at jenkins-hbase4.apache.org/33267] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 15:11:43,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-20 15:11:43,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-20 15:11:43,380 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41343] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1689865902037.c902fc21d635ffa07c05b0f13fefb29b. with WAL disabled. Data may be lost in the event of a crash. 2023-07-20 15:11:43,382 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46155] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1689865902037.9ed4601cb0f85ae18e43b33ef9413cf5. with WAL disabled. Data may be lost in the event of a crash. 2023-07-20 15:11:43,385 DEBUG [Listener at jenkins-hbase4.apache.org/33267] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:43,385 DEBUG [Listener at jenkins-hbase4.apache.org/33267] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689865902037.c902fc21d635ffa07c05b0f13fefb29b. 2023-07-20 15:11:43,385 INFO [Listener at jenkins-hbase4.apache.org/33267] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-20 15:11:43,398 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-20 15:11:43,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689865903398 (current time:1689865903398). 2023-07-20 15:11:43,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-20 15:11:43,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] zookeeper.ReadOnlyZKClient(139): Connect 0x7efc9fe5 to 127.0.0.1:64446 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 15:11:43,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@445affaf, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 15:11:43,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 15:11:43,412 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51952, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 15:11:43,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7efc9fe5 to 127.0.0.1:64446 2023-07-20 15:11:43,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 15:11:43,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] zookeeper.ReadOnlyZKClient(139): Connect 0x7275219a to 127.0.0.1:64446 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 15:11:43,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@686c9b86, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 15:11:43,423 DEBUG [hconnection-0x7bd8b6a3-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 15:11:43,427 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51966, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 15:11:43,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 15:11:43,433 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39630, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 15:11:43,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7275219a to 127.0.0.1:64446 2023-07-20 15:11:43,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 15:11:43,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-20 15:11:43,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-20 15:11:43,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-20 15:11:43,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-20 15:11:43,438 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-20 15:11:43,439 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689866503439 2023-07-20 15:11:43,439 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:43,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-20 15:11:43,442 DEBUG [Listener at jenkins-hbase4.apache.org/33267] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-20 15:11:43,442 DEBUG [Listener at jenkins-hbase4.apache.org/33267] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-20 15:11:43,443 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-20 15:11:43,444 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-20 15:11:43,445 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 7 msec 2023-07-20 15:11:43,446 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-20 15:11:43,447 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689866503447 2023-07-20 15:11:43,464 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:43,465 INFO [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-20 15:11:43,465 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 15:11:43,466 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-20 15:11:43,466 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-20 15:11:43,467 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:43,467 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:43,469 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:11:43,469 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:11:43,469 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:11:43,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:11:43,469 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:11:43,469 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:11:43,469 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:11:43,469 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:11:43,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:11:43,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:11:43,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:43,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:43,470 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:11:43,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:43,470 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:43,470 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:11:43,470 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:43,471 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:43,471 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:11:43,471 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-20 15:11:43,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-20 15:11:43,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:43,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-20 15:11:43,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:43,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-20 15:11:43,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:43,471 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-20 15:11:43,471 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-20 15:11:43,471 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-20 15:11:43,472 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:43,472 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-20 15:11:43,472 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 15:11:43,472 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:43,474 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:43,474 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-20 15:11:43,474 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-20 15:11:43,474 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-20 15:11:43,474 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-20 15:11:43,474 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37315,1689865822568' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-20 15:11:43,474 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 15:11:43,474 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 15:11:43,476 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-20 15:11:43,476 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-20 15:11:43,476 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-20 15:11:43,476 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41343,1689865822688' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-20 15:11:43,476 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-20 15:11:43,476 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46155,1689865822636' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-20 15:11:43,480 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:43,480 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:11:43,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:11:43,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:11:43,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:11:43,481 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:11:43,482 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:43,482 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:43,482 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 15:11:43,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:11:43,482 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:43,482 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 15:11:43,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:11:43,482 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:43,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:43,483 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:43,483 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 15:11:43,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:11:43,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:11:43,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:11:43,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:11:43,484 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41343,1689865822688' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-20 15:11:43,484 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6ef16fab[Count = 1] remaining members to acquire global barrier 2023-07-20 15:11:43,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:11:43,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:11:43,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:11:43,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:11:43,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:11:43,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:43,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:11:43,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:11:43,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:11:43,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:11:43,487 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46155,1689865822636' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-20 15:11:43,487 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6ef16fab[Count = 0] remaining members to acquire global barrier 2023-07-20 15:11:43,487 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-20 15:11:43,487 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:43,488 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:43,488 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:43,488 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:43,488 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:43,488 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:43,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:43,488 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:11:43,488 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:43,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:43,488 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-20 15:11:43,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:43,489 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-20 15:11:43,489 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 15:11:43,489 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 15:11:43,489 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-20 15:11:43,489 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-20 15:11:43,489 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:11:43,489 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-20 15:11:43,489 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,37315,1689865822568' in zk 2023-07-20 15:11:43,489 DEBUG [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689865902037.c902fc21d635ffa07c05b0f13fefb29b. 2023-07-20 15:11:43,489 DEBUG [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689865902037.c902fc21d635ffa07c05b0f13fefb29b. started... 2023-07-20 15:11:43,489 INFO [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] regionserver.HRegion(2745): Flushing c902fc21d635ffa07c05b0f13fefb29b 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-20 15:11:43,491 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-20 15:11:43,491 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 15:11:43,491 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-20 15:11:43,496 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 15:11:43,496 DEBUG [rs(jenkins-hbase4.apache.org,46155,1689865822636)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689865902037.9ed4601cb0f85ae18e43b33ef9413cf5. 2023-07-20 15:11:43,496 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 15:11:43,496 DEBUG [rs(jenkins-hbase4.apache.org,46155,1689865822636)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689865902037.9ed4601cb0f85ae18e43b33ef9413cf5. started... 2023-07-20 15:11:43,501 INFO [rs(jenkins-hbase4.apache.org,46155,1689865822636)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 9ed4601cb0f85ae18e43b33ef9413cf5 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-20 15:11:43,529 INFO [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230720cd2bbb15db0d4b87b93529f3f1d742b9 to hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230720cd2bbb15db0d4b87b93529f3f1d742b9 2023-07-20 15:11:43,530 INFO [rs(jenkins-hbase4.apache.org,46155,1689865822636)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307201697142938574251aeaf9862db77fd28 to hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202307201697142938574251aeaf9862db77fd28 2023-07-20 15:11:43,542 DEBUG [Listener at jenkins-hbase4.apache.org/33267] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 15:11:43,543 INFO [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportFileSystemStateWithMergeRegion/c902fc21d635ffa07c05b0f13fefb29b/.tmp/cf/2d4343fc0f624e2fad200343e05df25b 2023-07-20 15:11:43,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-20 15:11:43,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-20 15:11:43,543 DEBUG [Listener at jenkins-hbase4.apache.org/33267] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-20 15:11:43,545 INFO [rs(jenkins-hbase4.apache.org,46155,1689865822636)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportFileSystemStateWithMergeRegion/9ed4601cb0f85ae18e43b33ef9413cf5/.tmp/cf/e968b9d66e574ef287cb42cb5c362017 2023-07-20 15:11:43,552 DEBUG [rs(jenkins-hbase4.apache.org,46155,1689865822636)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportFileSystemStateWithMergeRegion/9ed4601cb0f85ae18e43b33ef9413cf5/.tmp/cf/e968b9d66e574ef287cb42cb5c362017 as hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportFileSystemStateWithMergeRegion/9ed4601cb0f85ae18e43b33ef9413cf5/cf/e968b9d66e574ef287cb42cb5c362017 2023-07-20 15:11:43,555 DEBUG [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportFileSystemStateWithMergeRegion/c902fc21d635ffa07c05b0f13fefb29b/.tmp/cf/2d4343fc0f624e2fad200343e05df25b as hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportFileSystemStateWithMergeRegion/c902fc21d635ffa07c05b0f13fefb29b/cf/2d4343fc0f624e2fad200343e05df25b 2023-07-20 15:11:43,557 INFO [rs(jenkins-hbase4.apache.org,46155,1689865822636)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportFileSystemStateWithMergeRegion/9ed4601cb0f85ae18e43b33ef9413cf5/cf/e968b9d66e574ef287cb42cb5c362017, entries=46, sequenceid=6, filesize=13.3 K 2023-07-20 15:11:43,558 INFO [rs(jenkins-hbase4.apache.org,46155,1689865822636)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 9ed4601cb0f85ae18e43b33ef9413cf5 in 58ms, sequenceid=6, compaction requested=false 2023-07-20 15:11:43,559 DEBUG [rs(jenkins-hbase4.apache.org,46155,1689865822636)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9ed4601cb0f85ae18e43b33ef9413cf5: 2023-07-20 15:11:43,559 DEBUG [rs(jenkins-hbase4.apache.org,46155,1689865822636)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689865902037.9ed4601cb0f85ae18e43b33ef9413cf5.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:43,559 DEBUG [rs(jenkins-hbase4.apache.org,46155,1689865822636)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 15:11:43,559 DEBUG [rs(jenkins-hbase4.apache.org,46155,1689865822636)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportFileSystemStateWithMergeRegion/9ed4601cb0f85ae18e43b33ef9413cf5/cf/e968b9d66e574ef287cb42cb5c362017] hfiles 2023-07-20 15:11:43,559 DEBUG [rs(jenkins-hbase4.apache.org,46155,1689865822636)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportFileSystemStateWithMergeRegion/9ed4601cb0f85ae18e43b33ef9413cf5/cf/e968b9d66e574ef287cb42cb5c362017 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:43,562 INFO [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportFileSystemStateWithMergeRegion/c902fc21d635ffa07c05b0f13fefb29b/cf/2d4343fc0f624e2fad200343e05df25b, entries=4, sequenceid=6, filesize=5.6 K 2023-07-20 15:11:43,562 INFO [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for c902fc21d635ffa07c05b0f13fefb29b in 73ms, sequenceid=6, compaction requested=false 2023-07-20 15:11:43,563 DEBUG [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c902fc21d635ffa07c05b0f13fefb29b: 2023-07-20 15:11:43,563 DEBUG [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689865902037.c902fc21d635ffa07c05b0f13fefb29b.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:43,563 DEBUG [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 15:11:43,563 DEBUG [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportFileSystemStateWithMergeRegion/c902fc21d635ffa07c05b0f13fefb29b/cf/2d4343fc0f624e2fad200343e05df25b] hfiles 2023-07-20 15:11:43,563 DEBUG [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportFileSystemStateWithMergeRegion/c902fc21d635ffa07c05b0f13fefb29b/cf/2d4343fc0f624e2fad200343e05df25b for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:43,580 DEBUG [rs(jenkins-hbase4.apache.org,46155,1689865822636)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689865902037.9ed4601cb0f85ae18e43b33ef9413cf5. completed. 2023-07-20 15:11:43,580 DEBUG [rs(jenkins-hbase4.apache.org,46155,1689865822636)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689865902037.9ed4601cb0f85ae18e43b33ef9413cf5. 2023-07-20 15:11:43,580 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 15:11:43,581 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 15:11:43,581 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:11:43,581 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-20 15:11:43,581 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,46155,1689865822636' in zk 2023-07-20 15:11:43,583 DEBUG [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689865902037.c902fc21d635ffa07c05b0f13fefb29b. completed. 2023-07-20 15:11:43,583 DEBUG [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689865902037.c902fc21d635ffa07c05b0f13fefb29b. 2023-07-20 15:11:43,583 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 15:11:43,583 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 15:11:43,583 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:11:43,583 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-20 15:11:43,583 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,41343,1689865822688' in zk 2023-07-20 15:11:43,584 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-20 15:11:43,584 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 15:11:43,584 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:11:43,584 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-20 15:11:43,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:11:43,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:11:43,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:11:43,588 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:11:43,588 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-20 15:11:43,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:11:43,588 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 15:11:43,589 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-20 15:11:43,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:11:43,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:43,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:11:43,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:11:43,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:11:43,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:11:43,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:43,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:11:43,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:11:43,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:11:43,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,46155,1689865822636': 2023-07-20 15:11:43,593 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46155,1689865822636' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-20 15:11:43,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:11:43,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:11:43,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:11:43,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:11:43,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:11:43,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:43,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:11:43,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:11:43,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:11:43,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:11:43,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:43,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:11:43,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:11:43,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:11:43,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,41343,1689865822688': 2023-07-20 15:11:43,597 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41343,1689865822688' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-20 15:11:43,597 INFO [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-20 15:11:43,597 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-20 15:11:43,597 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-20 15:11:43,597 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:43,597 INFO [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-20 15:11:43,603 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:43,603 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:43,603 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:43,603 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:43,603 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:43,603 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:11:43,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:43,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:11:43,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:11:43,603 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:43,604 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:11:43,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:43,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:43,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:11:43,603 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:11:43,604 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:11:43,604 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:43,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:43,604 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:11:43,604 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:11:43,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:11:43,604 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:11:43,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:43,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:11:43,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:43,605 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:11:43,605 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:11:43,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:11:43,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:11:43,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:43,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:43,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:43,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:11:43,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:11:43,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:11:43,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:11:43,608 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:11:43,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:43,608 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:11:43,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:11:43,609 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:11:43,612 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:11:43,612 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:43,612 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:11:43,612 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:11:43,612 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:11:43,612 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:11:43,612 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:11:43,612 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:11:43,612 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:43,612 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 15:11:43,612 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:11:43,612 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:11:43,612 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:11:43,614 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:11:43,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:11:43,614 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:11:43,612 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:43,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:11:43,615 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:43,612 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:43,615 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-20 15:11:43,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:11:43,615 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:11:43,615 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:43,615 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:11:43,615 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:11:43,615 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:43,615 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:43,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:11:43,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:11:43,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:11:43,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:11:43,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:11:43,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:11:43,616 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202307201697142938574251aeaf9862db77fd28, hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230720cd2bbb15db0d4b87b93529f3f1d742b9] mob files 2023-07-20 15:11:43,616 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202307201697142938574251aeaf9862db77fd28 2023-07-20 15:11:43,616 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230720cd2bbb15db0d4b87b93529f3f1d742b9 2023-07-20 15:11:43,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:11:43,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:11:43,624 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion because node does not exist (not an error) 2023-07-20 15:11:43,638 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:43,639 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:43,663 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:43,685 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-20 15:11:43,685 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:43,685 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:43,685 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689865903439Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1689865903638 (+199 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689865903638Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1689865903638Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1689865903645 (+7 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689865903655 (+10 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689865903685 (+30 ms) 2023-07-20 15:11:43,689 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-20 15:11:43,690 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 249 msec 2023-07-20 15:11:43,744 DEBUG [Listener at jenkins-hbase4.apache.org/33267] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 15:11:43,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-20 15:11:43,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-20 15:11:43,773 DEBUG [Listener at jenkins-hbase4.apache.org/33267] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-20 15:11:43,777 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51974, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-20 15:11:43,778 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37315] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-20 15:11:43,779 DEBUG [Listener at jenkins-hbase4.apache.org/33267] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-20 15:11:43,782 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39640, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-20 15:11:43,782 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41343] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-20 15:11:43,782 DEBUG [Listener at jenkins-hbase4.apache.org/33267] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-20 15:11:43,785 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53478, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-20 15:11:43,785 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46155] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-20 15:11:43,787 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-20 15:11:43,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] procedure2.ProcedureExecutor(1029): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:43,790 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-20 15:11:43,790 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-07-20 15:11:43,791 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-20 15:11:43,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-20 15:11:43,794 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/482247eb5ddda1c9439f2483c87acf91 2023-07-20 15:11:43,794 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ac82dd80f7377487de729691c28cd4b8 2023-07-20 15:11:43,795 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ac82dd80f7377487de729691c28cd4b8 empty. 2023-07-20 15:11:43,795 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/482247eb5ddda1c9439f2483c87acf91 empty. 2023-07-20 15:11:43,795 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ac82dd80f7377487de729691c28cd4b8 2023-07-20 15:11:43,795 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/482247eb5ddda1c9439f2483c87acf91 2023-07-20 15:11:43,795 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-20 15:11:43,810 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-07-20 15:11:43,812 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 482247eb5ddda1c9439f2483c87acf91, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689865903787.482247eb5ddda1c9439f2483c87acf91.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp 2023-07-20 15:11:43,812 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => ac82dd80f7377487de729691c28cd4b8, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689865903787.ac82dd80f7377487de729691c28cd4b8.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp 2023-07-20 15:11:43,832 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689865903787.482247eb5ddda1c9439f2483c87acf91.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 15:11:43,832 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing 482247eb5ddda1c9439f2483c87acf91, disabling compactions & flushes 2023-07-20 15:11:43,832 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689865903787.482247eb5ddda1c9439f2483c87acf91. 2023-07-20 15:11:43,832 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689865903787.482247eb5ddda1c9439f2483c87acf91. 2023-07-20 15:11:43,832 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689865903787.482247eb5ddda1c9439f2483c87acf91. after waiting 0 ms 2023-07-20 15:11:43,832 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689865903787.482247eb5ddda1c9439f2483c87acf91. 2023-07-20 15:11:43,832 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689865903787.482247eb5ddda1c9439f2483c87acf91. 2023-07-20 15:11:43,832 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for 482247eb5ddda1c9439f2483c87acf91: 2023-07-20 15:11:43,834 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689865903787.ac82dd80f7377487de729691c28cd4b8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 15:11:43,834 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing ac82dd80f7377487de729691c28cd4b8, disabling compactions & flushes 2023-07-20 15:11:43,834 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689865903787.ac82dd80f7377487de729691c28cd4b8. 2023-07-20 15:11:43,834 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689865903787.ac82dd80f7377487de729691c28cd4b8. 2023-07-20 15:11:43,834 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689865903787.ac82dd80f7377487de729691c28cd4b8. after waiting 0 ms 2023-07-20 15:11:43,834 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689865903787.ac82dd80f7377487de729691c28cd4b8. 2023-07-20 15:11:43,835 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689865903787.ac82dd80f7377487de729691c28cd4b8. 2023-07-20 15:11:43,835 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for ac82dd80f7377487de729691c28cd4b8: 2023-07-20 15:11:43,837 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-07-20 15:11:43,838 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689865903787.482247eb5ddda1c9439f2483c87acf91.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689865903838"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689865903838"}]},"ts":"1689865903838"} 2023-07-20 15:11:43,838 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689865903787.ac82dd80f7377487de729691c28cd4b8.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689865903838"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689865903838"}]},"ts":"1689865903838"} 2023-07-20 15:11:43,840 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-20 15:11:43,841 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-20 15:11:43,841 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689865903841"}]},"ts":"1689865903841"} 2023-07-20 15:11:43,842 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-07-20 15:11:43,846 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-20 15:11:43,847 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-20 15:11:43,847 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-20 15:11:43,847 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-20 15:11:43,847 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-20 15:11:43,847 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=482247eb5ddda1c9439f2483c87acf91, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ac82dd80f7377487de729691c28cd4b8, ASSIGN}] 2023-07-20 15:11:43,850 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ac82dd80f7377487de729691c28cd4b8, ASSIGN 2023-07-20 15:11:43,850 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=482247eb5ddda1c9439f2483c87acf91, ASSIGN 2023-07-20 15:11:43,850 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ac82dd80f7377487de729691c28cd4b8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37315,1689865822568; forceNewPlan=false, retain=false 2023-07-20 15:11:43,850 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=482247eb5ddda1c9439f2483c87acf91, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46155,1689865822636; forceNewPlan=false, retain=false 2023-07-20 15:11:43,893 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-20 15:11:44,001 INFO [jenkins-hbase4:38949] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-20 15:11:44,004 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=482247eb5ddda1c9439f2483c87acf91, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:11:44,004 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=ac82dd80f7377487de729691c28cd4b8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:11:44,004 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689865903787.ac82dd80f7377487de729691c28cd4b8.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689865904004"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689865904004"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689865904004"}]},"ts":"1689865904004"} 2023-07-20 15:11:44,004 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689865903787.482247eb5ddda1c9439f2483c87acf91.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689865904004"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689865904004"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689865904004"}]},"ts":"1689865904004"} 2023-07-20 15:11:44,006 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure 482247eb5ddda1c9439f2483c87acf91, server=jenkins-hbase4.apache.org,46155,1689865822636}] 2023-07-20 15:11:44,007 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=70, ppid=68, state=RUNNABLE; OpenRegionProcedure ac82dd80f7377487de729691c28cd4b8, server=jenkins-hbase4.apache.org,37315,1689865822568}] 2023-07-20 15:11:44,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-20 15:11:44,172 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689865903787.482247eb5ddda1c9439f2483c87acf91. 2023-07-20 15:11:44,172 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 482247eb5ddda1c9439f2483c87acf91, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689865903787.482247eb5ddda1c9439f2483c87acf91.', STARTKEY => '', ENDKEY => '2'} 2023-07-20 15:11:44,173 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689865903787.482247eb5ddda1c9439f2483c87acf91. service=AccessControlService 2023-07-20 15:11:44,173 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 15:11:44,173 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 482247eb5ddda1c9439f2483c87acf91 2023-07-20 15:11:44,173 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689865903787.482247eb5ddda1c9439f2483c87acf91.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 15:11:44,173 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 482247eb5ddda1c9439f2483c87acf91 2023-07-20 15:11:44,173 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1689865903787.ac82dd80f7377487de729691c28cd4b8. 2023-07-20 15:11:44,173 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 482247eb5ddda1c9439f2483c87acf91 2023-07-20 15:11:44,174 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ac82dd80f7377487de729691c28cd4b8, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689865903787.ac82dd80f7377487de729691c28cd4b8.', STARTKEY => '2', ENDKEY => ''} 2023-07-20 15:11:44,174 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1689865903787.ac82dd80f7377487de729691c28cd4b8. service=AccessControlService 2023-07-20 15:11:44,174 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 15:11:44,174 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 ac82dd80f7377487de729691c28cd4b8 2023-07-20 15:11:44,174 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689865903787.ac82dd80f7377487de729691c28cd4b8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 15:11:44,174 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ac82dd80f7377487de729691c28cd4b8 2023-07-20 15:11:44,174 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ac82dd80f7377487de729691c28cd4b8 2023-07-20 15:11:44,176 INFO [StoreOpener-482247eb5ddda1c9439f2483c87acf91-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 482247eb5ddda1c9439f2483c87acf91 2023-07-20 15:11:44,177 INFO [StoreOpener-ac82dd80f7377487de729691c28cd4b8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region ac82dd80f7377487de729691c28cd4b8 2023-07-20 15:11:44,178 DEBUG [StoreOpener-482247eb5ddda1c9439f2483c87acf91-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/482247eb5ddda1c9439f2483c87acf91/cf 2023-07-20 15:11:44,178 DEBUG [StoreOpener-ac82dd80f7377487de729691c28cd4b8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ac82dd80f7377487de729691c28cd4b8/cf 2023-07-20 15:11:44,178 DEBUG [StoreOpener-482247eb5ddda1c9439f2483c87acf91-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/482247eb5ddda1c9439f2483c87acf91/cf 2023-07-20 15:11:44,178 DEBUG [StoreOpener-ac82dd80f7377487de729691c28cd4b8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ac82dd80f7377487de729691c28cd4b8/cf 2023-07-20 15:11:44,179 INFO [StoreOpener-482247eb5ddda1c9439f2483c87acf91-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 482247eb5ddda1c9439f2483c87acf91 columnFamilyName cf 2023-07-20 15:11:44,179 INFO [StoreOpener-ac82dd80f7377487de729691c28cd4b8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ac82dd80f7377487de729691c28cd4b8 columnFamilyName cf 2023-07-20 15:11:44,180 INFO [StoreOpener-ac82dd80f7377487de729691c28cd4b8-1] regionserver.HStore(310): Store=ac82dd80f7377487de729691c28cd4b8/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 15:11:44,181 INFO [StoreOpener-482247eb5ddda1c9439f2483c87acf91-1] regionserver.HStore(310): Store=482247eb5ddda1c9439f2483c87acf91/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 15:11:44,181 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ac82dd80f7377487de729691c28cd4b8 2023-07-20 15:11:44,181 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/482247eb5ddda1c9439f2483c87acf91 2023-07-20 15:11:44,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ac82dd80f7377487de729691c28cd4b8 2023-07-20 15:11:44,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/482247eb5ddda1c9439f2483c87acf91 2023-07-20 15:11:44,185 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 482247eb5ddda1c9439f2483c87acf91 2023-07-20 15:11:44,185 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ac82dd80f7377487de729691c28cd4b8 2023-07-20 15:11:44,187 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/482247eb5ddda1c9439f2483c87acf91/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 15:11:44,187 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ac82dd80f7377487de729691c28cd4b8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 15:11:44,187 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 482247eb5ddda1c9439f2483c87acf91; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64372096, jitterRate=-0.04078102111816406}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 15:11:44,187 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 482247eb5ddda1c9439f2483c87acf91: 2023-07-20 15:11:44,188 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ac82dd80f7377487de729691c28cd4b8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63569234, jitterRate=-0.05274459719657898}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 15:11:44,188 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ac82dd80f7377487de729691c28cd4b8: 2023-07-20 15:11:44,188 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689865903787.482247eb5ddda1c9439f2483c87acf91., pid=69, masterSystemTime=1689865904162 2023-07-20 15:11:44,188 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689865903787.ac82dd80f7377487de729691c28cd4b8., pid=70, masterSystemTime=1689865904162 2023-07-20 15:11:44,190 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689865903787.482247eb5ddda1c9439f2483c87acf91. 2023-07-20 15:11:44,190 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689865903787.482247eb5ddda1c9439f2483c87acf91. 2023-07-20 15:11:44,191 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=482247eb5ddda1c9439f2483c87acf91, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:11:44,191 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689865903787.ac82dd80f7377487de729691c28cd4b8. 2023-07-20 15:11:44,191 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1689865903787.ac82dd80f7377487de729691c28cd4b8. 2023-07-20 15:11:44,191 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689865903787.482247eb5ddda1c9439f2483c87acf91.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689865904190"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689865904190"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689865904190"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689865904190"}]},"ts":"1689865904190"} 2023-07-20 15:11:44,191 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=ac82dd80f7377487de729691c28cd4b8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:11:44,191 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689865903787.ac82dd80f7377487de729691c28cd4b8.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689865904191"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689865904191"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689865904191"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689865904191"}]},"ts":"1689865904191"} 2023-07-20 15:11:44,195 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=67 2023-07-20 15:11:44,195 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure 482247eb5ddda1c9439f2483c87acf91, server=jenkins-hbase4.apache.org,46155,1689865822636 in 186 msec 2023-07-20 15:11:44,196 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=70, resume processing ppid=68 2023-07-20 15:11:44,196 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=68, state=SUCCESS; OpenRegionProcedure ac82dd80f7377487de729691c28cd4b8, server=jenkins-hbase4.apache.org,37315,1689865822568 in 187 msec 2023-07-20 15:11:44,196 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=482247eb5ddda1c9439f2483c87acf91, ASSIGN in 348 msec 2023-07-20 15:11:44,198 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=68, resume processing ppid=66 2023-07-20 15:11:44,198 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ac82dd80f7377487de729691c28cd4b8, ASSIGN in 349 msec 2023-07-20 15:11:44,198 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-20 15:11:44,198 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689865904198"}]},"ts":"1689865904198"} 2023-07-20 15:11:44,199 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-07-20 15:11:44,202 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-07-20 15:11:44,202 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-07-20 15:11:44,204 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41343] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-20 15:11:44,206 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 15:11:44,206 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 15:11:44,206 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 15:11:44,206 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 15:11:44,208 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-20 15:11:44,208 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-20 15:11:44,208 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-20 15:11:44,208 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-20 15:11:44,208 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-20 15:11:44,208 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-20 15:11:44,208 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-20 15:11:44,209 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-20 15:11:44,210 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 420 msec 2023-07-20 15:11:44,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-20 15:11:44,396 INFO [Listener at jenkins-hbase4.apache.org/33267] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-07-20 15:11:44,434 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions 482247eb5ddda1c9439f2483c87acf91, ac82dd80f7377487de729691c28cd4b8 2023-07-20 15:11:44,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[482247eb5ddda1c9439f2483c87acf91, ac82dd80f7377487de729691c28cd4b8], force=true 2023-07-20 15:11:44,448 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[482247eb5ddda1c9439f2483c87acf91, ac82dd80f7377487de729691c28cd4b8], force=true 2023-07-20 15:11:44,448 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[482247eb5ddda1c9439f2483c87acf91, ac82dd80f7377487de729691c28cd4b8], force=true 2023-07-20 15:11:44,448 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[482247eb5ddda1c9439f2483c87acf91, ac82dd80f7377487de729691c28cd4b8], force=true 2023-07-20 15:11:44,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-20 15:11:44,480 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=482247eb5ddda1c9439f2483c87acf91, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ac82dd80f7377487de729691c28cd4b8, UNASSIGN}] 2023-07-20 15:11:44,483 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=482247eb5ddda1c9439f2483c87acf91, UNASSIGN 2023-07-20 15:11:44,484 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ac82dd80f7377487de729691c28cd4b8, UNASSIGN 2023-07-20 15:11:44,487 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=482247eb5ddda1c9439f2483c87acf91, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:11:44,487 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=ac82dd80f7377487de729691c28cd4b8, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:11:44,488 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689865903787.482247eb5ddda1c9439f2483c87acf91.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689865904487"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689865904487"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689865904487"}]},"ts":"1689865904487"} 2023-07-20 15:11:44,488 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689865903787.ac82dd80f7377487de729691c28cd4b8.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689865904487"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689865904487"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689865904487"}]},"ts":"1689865904487"} 2023-07-20 15:11:44,491 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=74, ppid=72, state=RUNNABLE; CloseRegionProcedure 482247eb5ddda1c9439f2483c87acf91, server=jenkins-hbase4.apache.org,46155,1689865822636}] 2023-07-20 15:11:44,492 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=75, ppid=73, state=RUNNABLE; CloseRegionProcedure ac82dd80f7377487de729691c28cd4b8, server=jenkins-hbase4.apache.org,37315,1689865822568}] 2023-07-20 15:11:44,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-20 15:11:44,644 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 482247eb5ddda1c9439f2483c87acf91 2023-07-20 15:11:44,645 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 482247eb5ddda1c9439f2483c87acf91, disabling compactions & flushes 2023-07-20 15:11:44,645 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689865903787.482247eb5ddda1c9439f2483c87acf91. 2023-07-20 15:11:44,645 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689865903787.482247eb5ddda1c9439f2483c87acf91. 2023-07-20 15:11:44,645 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689865903787.482247eb5ddda1c9439f2483c87acf91. after waiting 0 ms 2023-07-20 15:11:44,645 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689865903787.482247eb5ddda1c9439f2483c87acf91. 2023-07-20 15:11:44,646 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 482247eb5ddda1c9439f2483c87acf91 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-20 15:11:44,646 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close ac82dd80f7377487de729691c28cd4b8 2023-07-20 15:11:44,647 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ac82dd80f7377487de729691c28cd4b8, disabling compactions & flushes 2023-07-20 15:11:44,647 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689865903787.ac82dd80f7377487de729691c28cd4b8. 2023-07-20 15:11:44,647 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689865903787.ac82dd80f7377487de729691c28cd4b8. 2023-07-20 15:11:44,647 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689865903787.ac82dd80f7377487de729691c28cd4b8. after waiting 0 ms 2023-07-20 15:11:44,647 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689865903787.ac82dd80f7377487de729691c28cd4b8. 2023-07-20 15:11:44,647 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing ac82dd80f7377487de729691c28cd4b8 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-20 15:11:44,674 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/482247eb5ddda1c9439f2483c87acf91/.tmp/cf/3d8cbe4cc8ea4b38ab9e856329c26946 2023-07-20 15:11:44,675 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ac82dd80f7377487de729691c28cd4b8/.tmp/cf/c5b41a4172e24d7f87c8f637bed413ba 2023-07-20 15:11:44,681 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/482247eb5ddda1c9439f2483c87acf91/.tmp/cf/3d8cbe4cc8ea4b38ab9e856329c26946 as hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/482247eb5ddda1c9439f2483c87acf91/cf/3d8cbe4cc8ea4b38ab9e856329c26946 2023-07-20 15:11:44,682 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ac82dd80f7377487de729691c28cd4b8/.tmp/cf/c5b41a4172e24d7f87c8f637bed413ba as hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ac82dd80f7377487de729691c28cd4b8/cf/c5b41a4172e24d7f87c8f637bed413ba 2023-07-20 15:11:44,687 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/482247eb5ddda1c9439f2483c87acf91/cf/3d8cbe4cc8ea4b38ab9e856329c26946, entries=1, sequenceid=5, filesize=4.7 K 2023-07-20 15:11:44,688 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ac82dd80f7377487de729691c28cd4b8/cf/c5b41a4172e24d7f87c8f637bed413ba, entries=1, sequenceid=5, filesize=4.7 K 2023-07-20 15:11:44,691 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 482247eb5ddda1c9439f2483c87acf91 in 45ms, sequenceid=5, compaction requested=false 2023-07-20 15:11:44,691 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for ac82dd80f7377487de729691c28cd4b8 in 44ms, sequenceid=5, compaction requested=false 2023-07-20 15:11:44,691 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-20 15:11:44,691 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-20 15:11:44,715 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ac82dd80f7377487de729691c28cd4b8/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-20 15:11:44,716 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 15:11:44,716 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689865903787.ac82dd80f7377487de729691c28cd4b8. 2023-07-20 15:11:44,716 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ac82dd80f7377487de729691c28cd4b8: 2023-07-20 15:11:44,720 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=ac82dd80f7377487de729691c28cd4b8, regionState=CLOSED 2023-07-20 15:11:44,720 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689865903787.ac82dd80f7377487de729691c28cd4b8.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689865904720"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689865904720"}]},"ts":"1689865904720"} 2023-07-20 15:11:44,722 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed ac82dd80f7377487de729691c28cd4b8 2023-07-20 15:11:44,724 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=75, resume processing ppid=73 2023-07-20 15:11:44,725 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=73, state=SUCCESS; CloseRegionProcedure ac82dd80f7377487de729691c28cd4b8, server=jenkins-hbase4.apache.org,37315,1689865822568 in 230 msec 2023-07-20 15:11:44,726 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ac82dd80f7377487de729691c28cd4b8, UNASSIGN in 245 msec 2023-07-20 15:11:44,728 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/482247eb5ddda1c9439f2483c87acf91/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-20 15:11:44,729 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 15:11:44,729 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689865903787.482247eb5ddda1c9439f2483c87acf91. 2023-07-20 15:11:44,729 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 482247eb5ddda1c9439f2483c87acf91: 2023-07-20 15:11:44,731 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 482247eb5ddda1c9439f2483c87acf91 2023-07-20 15:11:44,732 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=482247eb5ddda1c9439f2483c87acf91, regionState=CLOSED 2023-07-20 15:11:44,732 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689865903787.482247eb5ddda1c9439f2483c87acf91.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689865904732"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689865904732"}]},"ts":"1689865904732"} 2023-07-20 15:11:44,736 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=74, resume processing ppid=72 2023-07-20 15:11:44,736 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=72, state=SUCCESS; CloseRegionProcedure 482247eb5ddda1c9439f2483c87acf91, server=jenkins-hbase4.apache.org,46155,1689865822636 in 243 msec 2023-07-20 15:11:44,738 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=72, resume processing ppid=71 2023-07-20 15:11:44,738 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=482247eb5ddda1c9439f2483c87acf91, UNASSIGN in 260 msec 2023-07-20 15:11:44,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-20 15:11:44,807 DEBUG [PEWorker-2] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/757993aa10f06861b5e51cc77224622d/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-20 15:11:44,809 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689865903787.482247eb5ddda1c9439f2483c87acf91.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-20 15:11:44,810 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689865903787.ac82dd80f7377487de729691c28cd4b8.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-20 15:11:44,810 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689865903788.757993aa10f06861b5e51cc77224622d.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-20 15:11:44,861 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=757993aa10f06861b5e51cc77224622d, ASSIGN}] 2023-07-20 15:11:44,862 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=757993aa10f06861b5e51cc77224622d, ASSIGN 2023-07-20 15:11:44,863 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=757993aa10f06861b5e51cc77224622d, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,46155,1689865822636; forceNewPlan=false, retain=false 2023-07-20 15:11:45,013 INFO [jenkins-hbase4:38949] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-20 15:11:45,015 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=757993aa10f06861b5e51cc77224622d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:11:45,016 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689865903788.757993aa10f06861b5e51cc77224622d.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689865905015"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689865905015"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689865905015"}]},"ts":"1689865905015"} 2023-07-20 15:11:45,019 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure 757993aa10f06861b5e51cc77224622d, server=jenkins-hbase4.apache.org,46155,1689865822636}] 2023-07-20 15:11:45,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-20 15:11:45,173 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689865903788.757993aa10f06861b5e51cc77224622d. 2023-07-20 15:11:45,173 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 757993aa10f06861b5e51cc77224622d, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689865903788.757993aa10f06861b5e51cc77224622d.', STARTKEY => '', ENDKEY => ''} 2023-07-20 15:11:45,174 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689865903788.757993aa10f06861b5e51cc77224622d. service=AccessControlService 2023-07-20 15:11:45,174 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 15:11:45,174 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 757993aa10f06861b5e51cc77224622d 2023-07-20 15:11:45,174 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689865903788.757993aa10f06861b5e51cc77224622d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 15:11:45,174 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 757993aa10f06861b5e51cc77224622d 2023-07-20 15:11:45,174 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 757993aa10f06861b5e51cc77224622d 2023-07-20 15:11:45,175 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/757993aa10f06861b5e51cc77224622d/.regioninfo 2023-07-20 15:11:45,188 INFO [StoreOpener-757993aa10f06861b5e51cc77224622d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 757993aa10f06861b5e51cc77224622d 2023-07-20 15:11:45,191 DEBUG [StoreOpener-757993aa10f06861b5e51cc77224622d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/757993aa10f06861b5e51cc77224622d/cf 2023-07-20 15:11:45,191 DEBUG [StoreOpener-757993aa10f06861b5e51cc77224622d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/757993aa10f06861b5e51cc77224622d/cf 2023-07-20 15:11:45,191 INFO [StoreOpener-757993aa10f06861b5e51cc77224622d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 757993aa10f06861b5e51cc77224622d columnFamilyName cf 2023-07-20 15:11:45,242 DEBUG [StoreOpener-757993aa10f06861b5e51cc77224622d-1] regionserver.HStore(539): loaded hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/757993aa10f06861b5e51cc77224622d/cf/3d8cbe4cc8ea4b38ab9e856329c26946.482247eb5ddda1c9439f2483c87acf91->hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/482247eb5ddda1c9439f2483c87acf91/cf/3d8cbe4cc8ea4b38ab9e856329c26946-top 2023-07-20 15:11:45,250 DEBUG [StoreOpener-757993aa10f06861b5e51cc77224622d-1] regionserver.HStore(539): loaded hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/757993aa10f06861b5e51cc77224622d/cf/c5b41a4172e24d7f87c8f637bed413ba.ac82dd80f7377487de729691c28cd4b8->hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ac82dd80f7377487de729691c28cd4b8/cf/c5b41a4172e24d7f87c8f637bed413ba-top 2023-07-20 15:11:45,251 INFO [StoreOpener-757993aa10f06861b5e51cc77224622d-1] regionserver.HStore(310): Store=757993aa10f06861b5e51cc77224622d/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 15:11:45,252 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/757993aa10f06861b5e51cc77224622d 2023-07-20 15:11:45,253 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/757993aa10f06861b5e51cc77224622d 2023-07-20 15:11:45,257 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 757993aa10f06861b5e51cc77224622d 2023-07-20 15:11:45,258 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 757993aa10f06861b5e51cc77224622d; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59403581, jitterRate=-0.11481766402721405}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 15:11:45,258 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 757993aa10f06861b5e51cc77224622d: 2023-07-20 15:11:45,260 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689865903788.757993aa10f06861b5e51cc77224622d., pid=77, masterSystemTime=1689865905170 2023-07-20 15:11:45,260 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1689865903788.757993aa10f06861b5e51cc77224622d.,because compaction is disabled. 2023-07-20 15:11:45,262 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689865903788.757993aa10f06861b5e51cc77224622d. 2023-07-20 15:11:45,262 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689865903788.757993aa10f06861b5e51cc77224622d. 2023-07-20 15:11:45,262 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=757993aa10f06861b5e51cc77224622d, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:11:45,263 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689865903788.757993aa10f06861b5e51cc77224622d.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689865905262"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689865905262"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689865905262"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689865905262"}]},"ts":"1689865905262"} 2023-07-20 15:11:45,266 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-20 15:11:45,266 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure 757993aa10f06861b5e51cc77224622d, server=jenkins-hbase4.apache.org,46155,1689865822636 in 245 msec 2023-07-20 15:11:45,267 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=71 2023-07-20 15:11:45,267 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=757993aa10f06861b5e51cc77224622d, ASSIGN in 405 msec 2023-07-20 15:11:45,268 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[482247eb5ddda1c9439f2483c87acf91, ac82dd80f7377487de729691c28cd4b8], force=true in 829 msec 2023-07-20 15:11:45,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-20 15:11:45,568 INFO [Listener at jenkins-hbase4.apache.org/33267] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-07-20 15:11:45,570 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-20 15:11:45,570 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689865905570 (current time:1689865905570). 2023-07-20 15:11:45,570 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-20 15:11:45,570 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] zookeeper.ReadOnlyZKClient(139): Connect 0x4691701e to 127.0.0.1:64446 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 15:11:45,588 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3479b629, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 15:11:45,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 15:11:45,595 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51978, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 15:11:45,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4691701e to 127.0.0.1:64446 2023-07-20 15:11:45,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 15:11:45,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] zookeeper.ReadOnlyZKClient(139): Connect 0x4c095a1a to 127.0.0.1:64446 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 15:11:45,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@130fa86f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 15:11:45,612 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689865830265_0004_000001 (auth:SIMPLE) 2023-07-20 15:11:45,616 DEBUG [hconnection-0x4c93ddc2-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 15:11:45,625 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51980, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 15:11:45,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 15:11:45,634 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39656, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 15:11:45,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4c095a1a to 127.0.0.1:64446 2023-07-20 15:11:45,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 15:11:45,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-20 15:11:45,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-20 15:11:45,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-20 15:11:45,638 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-20 15:11:45,639 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-20 15:11:45,640 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1689866505640 2023-07-20 15:11:45,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-20 15:11:45,640 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,645 DEBUG [Listener at jenkins-hbase4.apache.org/33267] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-20 15:11:45,645 DEBUG [Listener at jenkins-hbase4.apache.org/33267] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-20 15:11:45,646 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-20 15:11:45,647 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-20 15:11:45,649 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 10 msec 2023-07-20 15:11:45,650 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-20 15:11:45,650 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1689866505650 2023-07-20 15:11:45,669 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,669 INFO [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-07-20 15:11:45,669 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 15:11:45,670 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-07-20 15:11:45,670 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-07-20 15:11:45,741 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,741 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,743 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:11:45,743 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:11:45,743 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:11:45,743 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:11:45,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:11:45,743 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:11:45,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:11:45,743 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:11:45,743 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:11:45,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:11:45,744 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:11:45,744 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-20 15:11:45,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,745 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,745 DEBUG [Listener at jenkins-hbase4.apache.org/33267] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 15:11:45,746 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-20 15:11:45,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,746 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-20 15:11:45,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-20 15:11:45,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-20 15:11:45,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-20 15:11:45,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,747 DEBUG [Listener at jenkins-hbase4.apache.org/33267] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-20 15:11:45,747 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,747 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-20 15:11:45,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-20 15:11:45,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,748 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-20 15:11:45,748 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,748 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-20 15:11:45,748 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 15:11:45,748 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,749 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-20 15:11:45,749 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 15:11:45,751 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,751 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-20 15:11:45,751 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 15:11:45,759 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-20 15:11:45,759 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-20 15:11:45,759 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41343,1689865822688' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-20 15:11:45,759 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-20 15:11:45,759 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-20 15:11:45,759 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46155,1689865822636' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-20 15:11:45,760 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-20 15:11:45,760 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-20 15:11:45,760 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37315,1689865822568' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-20 15:11:45,762 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,762 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:11:45,763 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:11:45,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:11:45,763 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,763 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:11:45,763 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 15:11:45,763 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,763 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 15:11:45,763 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,763 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 15:11:45,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:11:45,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:11:45,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:11:45,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:11:45,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:11:45,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:11:45,767 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46155,1689865822636' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-07-20 15:11:45,767 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2de20505[Count = 0] remaining members to acquire global barrier 2023-07-20 15:11:45,767 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-07-20 15:11:45,767 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,774 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,774 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,774 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,774 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,774 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,774 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-20 15:11:45,774 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:11:45,774 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-20 15:11:45,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,774 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,774 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-20 15:11:45,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,774 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,41343,1689865822688' in zk 2023-07-20 15:11:45,774 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-20 15:11:45,774 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-20 15:11:45,774 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 15:11:45,775 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 15:11:45,774 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-20 15:11:45,774 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,37315,1689865822568' in zk 2023-07-20 15:11:45,775 DEBUG [rs(jenkins-hbase4.apache.org,46155,1689865822636)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689865903788.757993aa10f06861b5e51cc77224622d. 2023-07-20 15:11:45,775 DEBUG [rs(jenkins-hbase4.apache.org,46155,1689865822636)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689865903788.757993aa10f06861b5e51cc77224622d. started... 2023-07-20 15:11:45,777 DEBUG [rs(jenkins-hbase4.apache.org,46155,1689865822636)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 757993aa10f06861b5e51cc77224622d: 2023-07-20 15:11:45,777 DEBUG [rs(jenkins-hbase4.apache.org,46155,1689865822636)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689865903788.757993aa10f06861b5e51cc77224622d.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,777 DEBUG [rs(jenkins-hbase4.apache.org,46155,1689865822636)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 15:11:45,777 DEBUG [rs(jenkins-hbase4.apache.org,46155,1689865822636)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/757993aa10f06861b5e51cc77224622d/cf/3d8cbe4cc8ea4b38ab9e856329c26946.482247eb5ddda1c9439f2483c87acf91->hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/482247eb5ddda1c9439f2483c87acf91/cf/3d8cbe4cc8ea4b38ab9e856329c26946-top, hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/757993aa10f06861b5e51cc77224622d/cf/c5b41a4172e24d7f87c8f637bed413ba.ac82dd80f7377487de729691c28cd4b8->hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ac82dd80f7377487de729691c28cd4b8/cf/c5b41a4172e24d7f87c8f637bed413ba-top] hfiles 2023-07-20 15:11:45,777 DEBUG [rs(jenkins-hbase4.apache.org,46155,1689865822636)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/757993aa10f06861b5e51cc77224622d/cf/3d8cbe4cc8ea4b38ab9e856329c26946.482247eb5ddda1c9439f2483c87acf91 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,778 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-20 15:11:45,778 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 15:11:45,778 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-20 15:11:45,779 DEBUG [rs(jenkins-hbase4.apache.org,46155,1689865822636)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/757993aa10f06861b5e51cc77224622d/cf/c5b41a4172e24d7f87c8f637bed413ba.ac82dd80f7377487de729691c28cd4b8 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,779 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-20 15:11:45,779 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 15:11:45,779 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-20 15:11:45,799 DEBUG [rs(jenkins-hbase4.apache.org,46155,1689865822636)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689865903788.757993aa10f06861b5e51cc77224622d. completed. 2023-07-20 15:11:45,799 DEBUG [rs(jenkins-hbase4.apache.org,46155,1689865822636)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689865903788.757993aa10f06861b5e51cc77224622d. 2023-07-20 15:11:45,799 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 15:11:45,799 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 15:11:45,799 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:11:45,799 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-20 15:11:45,799 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,46155,1689865822636' in zk 2023-07-20 15:11:45,807 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-20 15:11:45,807 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:11:45,807 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 15:11:45,807 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-20 15:11:45,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:11:45,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:11:45,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:11:45,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:11:45,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:11:45,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:11:45,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:11:45,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:11:45,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:11:45,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:11:45,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:11:45,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:11:45,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,46155,1689865822636': 2023-07-20 15:11:45,817 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46155,1689865822636' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-07-20 15:11:45,817 INFO [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-07-20 15:11:45,817 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-20 15:11:45,817 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-20 15:11:45,817 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,817 INFO [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-20 15:11:45,820 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,820 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,820 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,820 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,820 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,820 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:11:45,820 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:11:45,820 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,820 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,820 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:11:45,820 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:11:45,821 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:11:45,821 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:11:45,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:11:45,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:11:45,821 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:11:45,821 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:11:45,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:11:45,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,827 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:11:45,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:11:45,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:11:45,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:11:45,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:11:45,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,831 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:11:45,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:11:45,831 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:11:45,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:11:45,832 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:11:45,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:11:45,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:11:45,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:11:45,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:11:45,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:11:45,837 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:11:45,837 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:11:45,837 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:11:45,837 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:11:45,837 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:11:45,837 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:11:45,838 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:11:45,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:11:45,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:11:45,838 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:11:45,838 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 15:11:45,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:11:45,838 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:11:45,837 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:11:45,838 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,838 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,838 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,838 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:11:45,838 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:11:45,838 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:11:45,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:11:45,839 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:11:45,838 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,839 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:11:45,839 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,839 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:11:45,839 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:11:45,839 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,839 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:11:45,839 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:11:45,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:11:45,840 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,840 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 because node does not exist (not an error) 2023-07-20 15:11:45,922 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,947 DEBUG [Listener at jenkins-hbase4.apache.org/33267] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 15:11:45,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-20 15:11:45,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-20 15:11:45,958 DEBUG [Listener at jenkins-hbase4.apache.org/33267] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-20 15:11:46,028 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-07-20 15:11:46,028 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:46,029 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:46,029 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1689865905640Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689865905838 (+198 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689865905838Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689865905854 (+16 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689865905896 (+42 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1689865906028 (+132 ms) 2023-07-20 15:11:46,033 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-20 15:11:46,035 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 388 msec 2023-07-20 15:11:46,258 DEBUG [Listener at jenkins-hbase4.apache.org/33267] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 15:11:46,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-20 15:11:46,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-20 15:11:46,260 INFO [Listener at jenkins-hbase4.apache.org/33267] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/export-test/export-1689865906260 2023-07-20 15:11:46,260 INFO [Listener at jenkins-hbase4.apache.org/33267] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:42063, tgtDir=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/export-test/export-1689865906260, rawTgtDir=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/export-test/export-1689865906260, srcFsUri=hdfs://localhost:42063, srcDir=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b 2023-07-20 15:11:46,283 DEBUG [Listener at jenkins-hbase4.apache.org/33267] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:42063, inputRoot=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b 2023-07-20 15:11:46,283 DEBUG [Listener at jenkins-hbase4.apache.org/33267] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1970373392_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/export-test/export-1689865906260, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/export-test/export-1689865906260/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:46,283 INFO [Listener at jenkins-hbase4.apache.org/33267] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:42063, inputRoot=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b, snapshotDir=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-07-20 15:11:46,293 INFO [Listener at jenkins-hbase4.apache.org/33267] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/export-test/export-1689865906260/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:46,339 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-20 15:11:46,339 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-20 15:11:46,340 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-20 15:11:46,340 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-20 15:11:46,341 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-20 15:11:46,341 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-20 15:11:46,341 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-20 15:11:46,423 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a3c136b5-559e-274b-8286-a02c66f74c8f/hadoop-7258306408793693648.jar 2023-07-20 15:11:46,423 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-20 15:11:46,424 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-20 15:11:46,424 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-20 15:11:46,424 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-20 15:11:46,425 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-20 15:11:46,425 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-20 15:11:46,426 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-20 15:11:46,426 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-20 15:11:46,427 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-20 15:11:46,427 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-20 15:11:46,427 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-20 15:11:46,428 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-20 15:11:46,428 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-20 15:11:46,429 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-20 15:11:46,429 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-20 15:11:46,429 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-20 15:11:46,430 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 15:11:46,430 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 15:11:46,430 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 15:11:46,431 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 15:11:46,431 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 15:11:46,431 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 15:11:46,432 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 15:11:47,331 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-20 15:11:47,689 WARN [Listener at jenkins-hbase4.apache.org/33267] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-20 15:11:47,697 INFO [Listener at jenkins-hbase4.apache.org/33267] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-07-20 15:11:47,699 DEBUG [Listener at jenkins-hbase4.apache.org/33267] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-07-20 15:11:47,809 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-20 15:11:47,809 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-20 15:11:48,423 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689865830265_0005_000001 (auth:SIMPLE) 2023-07-20 15:11:54,690 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689865830265_0005_000001 (auth:SIMPLE) 2023-07-20 15:11:56,999 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689865830265_0005_000001 (auth:SIMPLE) 2023-07-20 15:12:00,894 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689865830265_0005_000001 (auth:SIMPLE) 2023-07-20 15:12:01,992 INFO [Listener at jenkins-hbase4.apache.org/33267] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-20 15:12:01,997 INFO [Listener at jenkins-hbase4.apache.org/33267] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-20 15:12:02,009 INFO [Listener at jenkins-hbase4.apache.org/33267] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:12:02,010 INFO [Listener at jenkins-hbase4.apache.org/33267] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-20 15:12:02,010 INFO [Listener at jenkins-hbase4.apache.org/33267] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-20 15:12:02,010 DEBUG [Listener at jenkins-hbase4.apache.org/33267] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_478830040_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:12:02,011 DEBUG [Listener at jenkins-hbase4.apache.org/33267] snapshot.TestExportSnapshot(367): hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-20 15:12:02,011 DEBUG [Listener at jenkins-hbase4.apache.org/33267] snapshot.TestExportSnapshot(367): hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-20 15:12:02,011 DEBUG [Listener at jenkins-hbase4.apache.org/33267] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_478830040_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/export-test/export-1689865906260/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/export-test/export-1689865906260/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:12:02,012 DEBUG [Listener at jenkins-hbase4.apache.org/33267] snapshot.TestExportSnapshot(367): hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/export-test/export-1689865906260/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-20 15:12:02,012 DEBUG [Listener at jenkins-hbase4.apache.org/33267] snapshot.TestExportSnapshot(367): hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/export-test/export-1689865906260/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-20 15:12:02,020 INFO [Listener at jenkins-hbase4.apache.org/33267] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:12:02,021 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:12:02,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] procedure2.ProcedureExecutor(1029): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:12:02,025 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-20 15:12:02,026 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689865922026"}]},"ts":"1689865922026"} 2023-07-20 15:12:02,027 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-07-20 15:12:02,029 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-07-20 15:12:02,030 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=757993aa10f06861b5e51cc77224622d, UNASSIGN}] 2023-07-20 15:12:02,032 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=757993aa10f06861b5e51cc77224622d, UNASSIGN 2023-07-20 15:12:02,033 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=757993aa10f06861b5e51cc77224622d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:12:02,033 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689865903788.757993aa10f06861b5e51cc77224622d.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689865922033"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689865922033"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689865922033"}]},"ts":"1689865922033"} 2023-07-20 15:12:02,035 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure 757993aa10f06861b5e51cc77224622d, server=jenkins-hbase4.apache.org,46155,1689865822636}] 2023-07-20 15:12:02,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-20 15:12:02,187 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 757993aa10f06861b5e51cc77224622d 2023-07-20 15:12:02,187 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 757993aa10f06861b5e51cc77224622d, disabling compactions & flushes 2023-07-20 15:12:02,187 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689865903788.757993aa10f06861b5e51cc77224622d. 2023-07-20 15:12:02,187 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689865903788.757993aa10f06861b5e51cc77224622d. 2023-07-20 15:12:02,187 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689865903788.757993aa10f06861b5e51cc77224622d. after waiting 0 ms 2023-07-20 15:12:02,187 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689865903788.757993aa10f06861b5e51cc77224622d. 2023-07-20 15:12:02,203 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/757993aa10f06861b5e51cc77224622d/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-20 15:12:02,204 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 15:12:02,205 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689865903788.757993aa10f06861b5e51cc77224622d. 2023-07-20 15:12:02,205 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 757993aa10f06861b5e51cc77224622d: 2023-07-20 15:12:02,206 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 757993aa10f06861b5e51cc77224622d 2023-07-20 15:12:02,207 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=757993aa10f06861b5e51cc77224622d, regionState=CLOSED 2023-07-20 15:12:02,207 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689865903788.757993aa10f06861b5e51cc77224622d.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689865922207"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689865922207"}]},"ts":"1689865922207"} 2023-07-20 15:12:02,211 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=81 2023-07-20 15:12:02,211 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure 757993aa10f06861b5e51cc77224622d, server=jenkins-hbase4.apache.org,46155,1689865822636 in 174 msec 2023-07-20 15:12:02,213 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=80 2023-07-20 15:12:02,213 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=757993aa10f06861b5e51cc77224622d, UNASSIGN in 181 msec 2023-07-20 15:12:02,214 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689865922214"}]},"ts":"1689865922214"} 2023-07-20 15:12:02,215 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-07-20 15:12:02,217 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-07-20 15:12:02,218 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 196 msec 2023-07-20 15:12:02,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-20 15:12:02,328 INFO [Listener at jenkins-hbase4.apache.org/33267] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-07-20 15:12:02,329 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:12:02,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] procedure2.ProcedureExecutor(1029): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:12:02,333 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:12:02,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:12:02,333 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:12:02,335 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41343] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:12:02,338 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:12:02,338 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:12:02,338 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:12:02,338 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:12:02,338 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ac82dd80f7377487de729691c28cd4b8 2023-07-20 15:12:02,338 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/482247eb5ddda1c9439f2483c87acf91 2023-07-20 15:12:02,338 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/757993aa10f06861b5e51cc77224622d 2023-07-20 15:12:02,339 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-20 15:12:02,339 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-20 15:12:02,339 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-20 15:12:02,339 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-20 15:12:02,340 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/757993aa10f06861b5e51cc77224622d/cf, FileablePath, hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/757993aa10f06861b5e51cc77224622d/recovered.edits] 2023-07-20 15:12:02,340 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ac82dd80f7377487de729691c28cd4b8/cf, FileablePath, hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ac82dd80f7377487de729691c28cd4b8/recovered.edits] 2023-07-20 15:12:02,341 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:12:02,341 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:12:02,341 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:12:02,341 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 15:12:02,341 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 15:12:02,341 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:12:02,341 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 15:12:02,341 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 15:12:02,342 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-20 15:12:02,342 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-20 15:12:02,342 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-20 15:12:02,342 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-20 15:12:02,343 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-20 15:12:02,344 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/482247eb5ddda1c9439f2483c87acf91/cf, FileablePath, hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/482247eb5ddda1c9439f2483c87acf91/recovered.edits] 2023-07-20 15:12:02,348 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ac82dd80f7377487de729691c28cd4b8/cf/c5b41a4172e24d7f87c8f637bed413ba to hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ac82dd80f7377487de729691c28cd4b8/cf/c5b41a4172e24d7f87c8f637bed413ba 2023-07-20 15:12:02,348 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/757993aa10f06861b5e51cc77224622d/cf/3d8cbe4cc8ea4b38ab9e856329c26946.482247eb5ddda1c9439f2483c87acf91 to hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/757993aa10f06861b5e51cc77224622d/cf/3d8cbe4cc8ea4b38ab9e856329c26946.482247eb5ddda1c9439f2483c87acf91 2023-07-20 15:12:02,350 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/482247eb5ddda1c9439f2483c87acf91/cf/3d8cbe4cc8ea4b38ab9e856329c26946 to hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/482247eb5ddda1c9439f2483c87acf91/cf/3d8cbe4cc8ea4b38ab9e856329c26946 2023-07-20 15:12:02,351 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/757993aa10f06861b5e51cc77224622d/cf/c5b41a4172e24d7f87c8f637bed413ba.ac82dd80f7377487de729691c28cd4b8 to hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/757993aa10f06861b5e51cc77224622d/cf/c5b41a4172e24d7f87c8f637bed413ba.ac82dd80f7377487de729691c28cd4b8 2023-07-20 15:12:02,352 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ac82dd80f7377487de729691c28cd4b8/recovered.edits/8.seqid to hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ac82dd80f7377487de729691c28cd4b8/recovered.edits/8.seqid 2023-07-20 15:12:02,352 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ac82dd80f7377487de729691c28cd4b8 2023-07-20 15:12:02,354 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/482247eb5ddda1c9439f2483c87acf91/recovered.edits/8.seqid to hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/482247eb5ddda1c9439f2483c87acf91/recovered.edits/8.seqid 2023-07-20 15:12:02,354 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/482247eb5ddda1c9439f2483c87acf91 2023-07-20 15:12:02,355 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/757993aa10f06861b5e51cc77224622d/recovered.edits/12.seqid to hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/757993aa10f06861b5e51cc77224622d/recovered.edits/12.seqid 2023-07-20 15:12:02,356 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/757993aa10f06861b5e51cc77224622d 2023-07-20 15:12:02,356 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-20 15:12:02,366 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:12:02,369 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-07-20 15:12:02,372 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-07-20 15:12:02,374 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:12:02,374 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-07-20 15:12:02,374 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689865903788.757993aa10f06861b5e51cc77224622d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689865922374"}]},"ts":"9223372036854775807"} 2023-07-20 15:12:02,386 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-20 15:12:02,386 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 757993aa10f06861b5e51cc77224622d, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689865903788.757993aa10f06861b5e51cc77224622d.', STARTKEY => '', ENDKEY => ''}] 2023-07-20 15:12:02,386 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-07-20 15:12:02,386 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689865922386"}]},"ts":"9223372036854775807"} 2023-07-20 15:12:02,388 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-07-20 15:12:02,403 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:12:02,406 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 74 msec 2023-07-20 15:12:02,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-20 15:12:02,445 INFO [Listener at jenkins-hbase4.apache.org/33267] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-07-20 15:12:02,445 INFO [Listener at jenkins-hbase4.apache.org/33267] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 15:12:02,446 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 15:12:02,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] procedure2.ProcedureExecutor(1029): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 15:12:02,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-20 15:12:02,461 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689865922461"}]},"ts":"1689865922461"} 2023-07-20 15:12:02,462 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-07-20 15:12:02,464 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-07-20 15:12:02,464 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c902fc21d635ffa07c05b0f13fefb29b, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=9ed4601cb0f85ae18e43b33ef9413cf5, UNASSIGN}] 2023-07-20 15:12:02,467 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c902fc21d635ffa07c05b0f13fefb29b, UNASSIGN 2023-07-20 15:12:02,467 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=9ed4601cb0f85ae18e43b33ef9413cf5, UNASSIGN 2023-07-20 15:12:02,473 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=c902fc21d635ffa07c05b0f13fefb29b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:12:02,473 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689865902037.c902fc21d635ffa07c05b0f13fefb29b.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689865922473"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689865922473"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689865922473"}]},"ts":"1689865922473"} 2023-07-20 15:12:02,473 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=9ed4601cb0f85ae18e43b33ef9413cf5, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:12:02,474 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689865902037.9ed4601cb0f85ae18e43b33ef9413cf5.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689865922473"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689865922473"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689865922473"}]},"ts":"1689865922473"} 2023-07-20 15:12:02,475 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=85, state=RUNNABLE; CloseRegionProcedure c902fc21d635ffa07c05b0f13fefb29b, server=jenkins-hbase4.apache.org,41343,1689865822688}] 2023-07-20 15:12:02,476 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=86, state=RUNNABLE; CloseRegionProcedure 9ed4601cb0f85ae18e43b33ef9413cf5, server=jenkins-hbase4.apache.org,46155,1689865822636}] 2023-07-20 15:12:02,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-20 15:12:02,626 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close c902fc21d635ffa07c05b0f13fefb29b 2023-07-20 15:12:02,627 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c902fc21d635ffa07c05b0f13fefb29b, disabling compactions & flushes 2023-07-20 15:12:02,627 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689865902037.c902fc21d635ffa07c05b0f13fefb29b. 2023-07-20 15:12:02,627 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689865902037.c902fc21d635ffa07c05b0f13fefb29b. 2023-07-20 15:12:02,627 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689865902037.c902fc21d635ffa07c05b0f13fefb29b. after waiting 0 ms 2023-07-20 15:12:02,627 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689865902037.c902fc21d635ffa07c05b0f13fefb29b. 2023-07-20 15:12:02,632 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 9ed4601cb0f85ae18e43b33ef9413cf5 2023-07-20 15:12:02,633 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 9ed4601cb0f85ae18e43b33ef9413cf5, disabling compactions & flushes 2023-07-20 15:12:02,633 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689865902037.9ed4601cb0f85ae18e43b33ef9413cf5. 2023-07-20 15:12:02,633 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689865902037.9ed4601cb0f85ae18e43b33ef9413cf5. 2023-07-20 15:12:02,633 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689865902037.9ed4601cb0f85ae18e43b33ef9413cf5. after waiting 0 ms 2023-07-20 15:12:02,633 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689865902037.9ed4601cb0f85ae18e43b33ef9413cf5. 2023-07-20 15:12:02,640 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportFileSystemStateWithMergeRegion/c902fc21d635ffa07c05b0f13fefb29b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-20 15:12:02,641 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportFileSystemStateWithMergeRegion/9ed4601cb0f85ae18e43b33ef9413cf5/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-20 15:12:02,641 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 15:12:02,642 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689865902037.c902fc21d635ffa07c05b0f13fefb29b. 2023-07-20 15:12:02,642 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c902fc21d635ffa07c05b0f13fefb29b: 2023-07-20 15:12:02,642 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 15:12:02,644 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689865902037.9ed4601cb0f85ae18e43b33ef9413cf5. 2023-07-20 15:12:02,644 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 9ed4601cb0f85ae18e43b33ef9413cf5: 2023-07-20 15:12:02,645 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed c902fc21d635ffa07c05b0f13fefb29b 2023-07-20 15:12:02,646 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=c902fc21d635ffa07c05b0f13fefb29b, regionState=CLOSED 2023-07-20 15:12:02,646 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 9ed4601cb0f85ae18e43b33ef9413cf5 2023-07-20 15:12:02,647 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689865902037.c902fc21d635ffa07c05b0f13fefb29b.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689865922646"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689865922646"}]},"ts":"1689865922646"} 2023-07-20 15:12:02,647 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=9ed4601cb0f85ae18e43b33ef9413cf5, regionState=CLOSED 2023-07-20 15:12:02,647 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689865902037.9ed4601cb0f85ae18e43b33ef9413cf5.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689865922647"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689865922647"}]},"ts":"1689865922647"} 2023-07-20 15:12:02,659 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=85 2023-07-20 15:12:02,659 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=85, state=SUCCESS; CloseRegionProcedure c902fc21d635ffa07c05b0f13fefb29b, server=jenkins-hbase4.apache.org,41343,1689865822688 in 182 msec 2023-07-20 15:12:02,660 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=86 2023-07-20 15:12:02,660 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=86, state=SUCCESS; CloseRegionProcedure 9ed4601cb0f85ae18e43b33ef9413cf5, server=jenkins-hbase4.apache.org,46155,1689865822636 in 182 msec 2023-07-20 15:12:02,661 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c902fc21d635ffa07c05b0f13fefb29b, UNASSIGN in 196 msec 2023-07-20 15:12:02,662 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=86, resume processing ppid=84 2023-07-20 15:12:02,663 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=9ed4601cb0f85ae18e43b33ef9413cf5, UNASSIGN in 196 msec 2023-07-20 15:12:02,663 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689865922663"}]},"ts":"1689865922663"} 2023-07-20 15:12:02,665 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-07-20 15:12:02,671 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-07-20 15:12:02,679 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 229 msec 2023-07-20 15:12:02,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-20 15:12:02,762 INFO [Listener at jenkins-hbase4.apache.org/33267] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-07-20 15:12:02,763 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 15:12:02,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] procedure2.ProcedureExecutor(1029): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 15:12:02,767 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 15:12:02,767 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 15:12:02,768 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 15:12:02,769 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41343] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 15:12:02,773 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c902fc21d635ffa07c05b0f13fefb29b 2023-07-20 15:12:02,773 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9ed4601cb0f85ae18e43b33ef9413cf5 2023-07-20 15:12:02,774 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 15:12:02,774 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 15:12:02,775 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 15:12:02,775 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-20 15:12:02,776 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-20 15:12:02,776 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-20 15:12:02,776 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 15:12:02,776 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 15:12:02,777 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 15:12:02,777 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 15:12:02,777 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 15:12:02,777 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 15:12:02,777 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 15:12:02,777 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 15:12:02,778 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data null 2023-07-20 15:12:02,778 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-20 15:12:02,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-20 15:12:02,779 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c902fc21d635ffa07c05b0f13fefb29b/cf, FileablePath, hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c902fc21d635ffa07c05b0f13fefb29b/recovered.edits] 2023-07-20 15:12:02,779 DEBUG [HFileArchiver-16] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9ed4601cb0f85ae18e43b33ef9413cf5/cf, FileablePath, hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9ed4601cb0f85ae18e43b33ef9413cf5/recovered.edits] 2023-07-20 15:12:02,785 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c902fc21d635ffa07c05b0f13fefb29b/cf/2d4343fc0f624e2fad200343e05df25b to hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/c902fc21d635ffa07c05b0f13fefb29b/cf/2d4343fc0f624e2fad200343e05df25b 2023-07-20 15:12:02,785 DEBUG [HFileArchiver-16] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9ed4601cb0f85ae18e43b33ef9413cf5/cf/e968b9d66e574ef287cb42cb5c362017 to hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/9ed4601cb0f85ae18e43b33ef9413cf5/cf/e968b9d66e574ef287cb42cb5c362017 2023-07-20 15:12:02,789 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c902fc21d635ffa07c05b0f13fefb29b/recovered.edits/9.seqid to hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/c902fc21d635ffa07c05b0f13fefb29b/recovered.edits/9.seqid 2023-07-20 15:12:02,790 DEBUG [HFileArchiver-16] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9ed4601cb0f85ae18e43b33ef9413cf5/recovered.edits/9.seqid to hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/9ed4601cb0f85ae18e43b33ef9413cf5/recovered.edits/9.seqid 2023-07-20 15:12:02,792 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c902fc21d635ffa07c05b0f13fefb29b 2023-07-20 15:12:02,792 DEBUG [HFileArchiver-16] backup.HFileArchiver(596): Deleted hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9ed4601cb0f85ae18e43b33ef9413cf5 2023-07-20 15:12:02,792 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-20 15:12:02,793 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-07-20 15:12:02,794 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-07-20 15:12:02,800 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202307201697142938574251aeaf9862db77fd28 to hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202307201697142938574251aeaf9862db77fd28 2023-07-20 15:12:02,801 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230720cd2bbb15db0d4b87b93529f3f1d742b9 to hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230720cd2bbb15db0d4b87b93529f3f1d742b9 2023-07-20 15:12:02,802 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-07-20 15:12:02,805 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 15:12:02,817 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-07-20 15:12:02,825 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-07-20 15:12:02,826 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 15:12:02,826 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-07-20 15:12:02,826 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689865902037.c902fc21d635ffa07c05b0f13fefb29b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689865922826"}]},"ts":"9223372036854775807"} 2023-07-20 15:12:02,826 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689865902037.9ed4601cb0f85ae18e43b33ef9413cf5.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689865922826"}]},"ts":"9223372036854775807"} 2023-07-20 15:12:02,830 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-20 15:12:02,830 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => c902fc21d635ffa07c05b0f13fefb29b, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689865902037.c902fc21d635ffa07c05b0f13fefb29b.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 9ed4601cb0f85ae18e43b33ef9413cf5, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689865902037.9ed4601cb0f85ae18e43b33ef9413cf5.', STARTKEY => '1', ENDKEY => ''}] 2023-07-20 15:12:02,830 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-07-20 15:12:02,830 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689865922830"}]},"ts":"9223372036854775807"} 2023-07-20 15:12:02,832 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-07-20 15:12:02,835 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 15:12:02,836 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 72 msec 2023-07-20 15:12:02,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-20 15:12:02,881 INFO [Listener at jenkins-hbase4.apache.org/33267] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-07-20 15:12:02,893 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-20 15:12:02,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38949] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:12:02,897 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-20 15:12:02,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:12:02,904 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-07-20 15:12:02,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:12:02,938 INFO [Listener at jenkins-hbase4.apache.org/33267] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=757 (was 744) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3c085ba2-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3c085ba2-shared-pool-27 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1484284473) connection to jenkins-hbase4.apache.org/172.31.14.131:45637 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1564106027_1 at /127.0.0.1:53416 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3c085ba2-shared-pool-28 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3c085ba2-shared-pool-29 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4096 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_478830040_17 at /127.0.0.1:53432 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_478830040_17 at /127.0.0.1:36836 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3c085ba2-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1564106027_1 at /127.0.0.1:36822 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3c085ba2-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_478830040_17 at /127.0.0.1:39780 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=907 (was 896) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=562 (was 434) - SystemLoadAverage LEAK? -, ProcessCount=185 (was 185), AvailableMemoryMB=2744 (was 2894) 2023-07-20 15:12:02,938 WARN [Listener at jenkins-hbase4.apache.org/33267] hbase.ResourceChecker(130): Thread=757 is superior to 500 2023-07-20 15:12:02,964 INFO [Listener at jenkins-hbase4.apache.org/33267] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=757, OpenFileDescriptor=907, MaxFileDescriptor=60000, SystemLoadAverage=562, ProcessCount=185, AvailableMemoryMB=2740 2023-07-20 15:12:02,964 WARN [Listener at jenkins-hbase4.apache.org/33267] hbase.ResourceChecker(130): Thread=757 is superior to 500 2023-07-20 15:12:02,966 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-20 15:12:02,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] procedure2.ProcedureExecutor(1029): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-20 15:12:02,971 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-20 15:12:02,971 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-07-20 15:12:02,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-20 15:12:02,973 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-20 15:12:02,975 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testEmptyExportFileSystemState/a7da6f38e4e2dd9f3f1aabcb2d4297cd 2023-07-20 15:12:02,975 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testEmptyExportFileSystemState/fa30491dfe1c0eb16bfd830b3ba58c58 2023-07-20 15:12:02,976 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testEmptyExportFileSystemState/a7da6f38e4e2dd9f3f1aabcb2d4297cd empty. 2023-07-20 15:12:02,976 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testEmptyExportFileSystemState/fa30491dfe1c0eb16bfd830b3ba58c58 empty. 2023-07-20 15:12:02,977 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testEmptyExportFileSystemState/a7da6f38e4e2dd9f3f1aabcb2d4297cd 2023-07-20 15:12:02,978 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testEmptyExportFileSystemState/fa30491dfe1c0eb16bfd830b3ba58c58 2023-07-20 15:12:02,978 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-20 15:12:03,041 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-20 15:12:03,043 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => a7da6f38e4e2dd9f3f1aabcb2d4297cd, NAME => 'testtb-testEmptyExportFileSystemState,,1689865922966.a7da6f38e4e2dd9f3f1aabcb2d4297cd.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp 2023-07-20 15:12:03,051 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => fa30491dfe1c0eb16bfd830b3ba58c58, NAME => 'testtb-testEmptyExportFileSystemState,1,1689865922966.fa30491dfe1c0eb16bfd830b3ba58c58.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp 2023-07-20 15:12:03,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-20 15:12:03,119 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689865922966.a7da6f38e4e2dd9f3f1aabcb2d4297cd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 15:12:03,119 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing a7da6f38e4e2dd9f3f1aabcb2d4297cd, disabling compactions & flushes 2023-07-20 15:12:03,119 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689865922966.a7da6f38e4e2dd9f3f1aabcb2d4297cd. 2023-07-20 15:12:03,119 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689865922966.a7da6f38e4e2dd9f3f1aabcb2d4297cd. 2023-07-20 15:12:03,119 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689865922966.a7da6f38e4e2dd9f3f1aabcb2d4297cd. after waiting 0 ms 2023-07-20 15:12:03,119 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689865922966.a7da6f38e4e2dd9f3f1aabcb2d4297cd. 2023-07-20 15:12:03,119 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689865922966.a7da6f38e4e2dd9f3f1aabcb2d4297cd. 2023-07-20 15:12:03,119 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for a7da6f38e4e2dd9f3f1aabcb2d4297cd: 2023-07-20 15:12:03,139 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689865922966.fa30491dfe1c0eb16bfd830b3ba58c58.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 15:12:03,139 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing fa30491dfe1c0eb16bfd830b3ba58c58, disabling compactions & flushes 2023-07-20 15:12:03,139 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689865922966.fa30491dfe1c0eb16bfd830b3ba58c58. 2023-07-20 15:12:03,139 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689865922966.fa30491dfe1c0eb16bfd830b3ba58c58. 2023-07-20 15:12:03,139 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689865922966.fa30491dfe1c0eb16bfd830b3ba58c58. after waiting 0 ms 2023-07-20 15:12:03,139 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689865922966.fa30491dfe1c0eb16bfd830b3ba58c58. 2023-07-20 15:12:03,139 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689865922966.fa30491dfe1c0eb16bfd830b3ba58c58. 2023-07-20 15:12:03,140 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for fa30491dfe1c0eb16bfd830b3ba58c58: 2023-07-20 15:12:03,143 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-20 15:12:03,144 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689865922966.a7da6f38e4e2dd9f3f1aabcb2d4297cd.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689865923144"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689865923144"}]},"ts":"1689865923144"} 2023-07-20 15:12:03,145 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689865922966.fa30491dfe1c0eb16bfd830b3ba58c58.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689865923144"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689865923144"}]},"ts":"1689865923144"} 2023-07-20 15:12:03,147 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-20 15:12:03,151 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-20 15:12:03,151 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689865923151"}]},"ts":"1689865923151"} 2023-07-20 15:12:03,153 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-07-20 15:12:03,157 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-20 15:12:03,159 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-20 15:12:03,160 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-20 15:12:03,160 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-20 15:12:03,160 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-20 15:12:03,160 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=a7da6f38e4e2dd9f3f1aabcb2d4297cd, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=fa30491dfe1c0eb16bfd830b3ba58c58, ASSIGN}] 2023-07-20 15:12:03,164 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=a7da6f38e4e2dd9f3f1aabcb2d4297cd, ASSIGN 2023-07-20 15:12:03,164 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=fa30491dfe1c0eb16bfd830b3ba58c58, ASSIGN 2023-07-20 15:12:03,167 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=a7da6f38e4e2dd9f3f1aabcb2d4297cd, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37315,1689865822568; forceNewPlan=false, retain=false 2023-07-20 15:12:03,167 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=fa30491dfe1c0eb16bfd830b3ba58c58, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41343,1689865822688; forceNewPlan=false, retain=false 2023-07-20 15:12:03,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-20 15:12:03,317 INFO [jenkins-hbase4:38949] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-20 15:12:03,321 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=fa30491dfe1c0eb16bfd830b3ba58c58, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:12:03,321 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689865922966.fa30491dfe1c0eb16bfd830b3ba58c58.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689865923321"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689865923321"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689865923321"}]},"ts":"1689865923321"} 2023-07-20 15:12:03,321 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=a7da6f38e4e2dd9f3f1aabcb2d4297cd, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:12:03,322 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689865922966.a7da6f38e4e2dd9f3f1aabcb2d4297cd.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689865923321"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689865923321"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689865923321"}]},"ts":"1689865923321"} 2023-07-20 15:12:03,327 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=92, state=RUNNABLE; OpenRegionProcedure fa30491dfe1c0eb16bfd830b3ba58c58, server=jenkins-hbase4.apache.org,41343,1689865822688}] 2023-07-20 15:12:03,329 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; OpenRegionProcedure a7da6f38e4e2dd9f3f1aabcb2d4297cd, server=jenkins-hbase4.apache.org,37315,1689865822568}] 2023-07-20 15:12:03,487 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1689865922966.fa30491dfe1c0eb16bfd830b3ba58c58. 2023-07-20 15:12:03,487 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => fa30491dfe1c0eb16bfd830b3ba58c58, NAME => 'testtb-testEmptyExportFileSystemState,1,1689865922966.fa30491dfe1c0eb16bfd830b3ba58c58.', STARTKEY => '1', ENDKEY => ''} 2023-07-20 15:12:03,487 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1689865922966.fa30491dfe1c0eb16bfd830b3ba58c58. service=AccessControlService 2023-07-20 15:12:03,487 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 15:12:03,488 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState fa30491dfe1c0eb16bfd830b3ba58c58 2023-07-20 15:12:03,488 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689865922966.fa30491dfe1c0eb16bfd830b3ba58c58.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 15:12:03,488 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for fa30491dfe1c0eb16bfd830b3ba58c58 2023-07-20 15:12:03,488 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for fa30491dfe1c0eb16bfd830b3ba58c58 2023-07-20 15:12:03,489 INFO [StoreOpener-fa30491dfe1c0eb16bfd830b3ba58c58-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region fa30491dfe1c0eb16bfd830b3ba58c58 2023-07-20 15:12:03,489 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1689865922966.a7da6f38e4e2dd9f3f1aabcb2d4297cd. 2023-07-20 15:12:03,489 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a7da6f38e4e2dd9f3f1aabcb2d4297cd, NAME => 'testtb-testEmptyExportFileSystemState,,1689865922966.a7da6f38e4e2dd9f3f1aabcb2d4297cd.', STARTKEY => '', ENDKEY => '1'} 2023-07-20 15:12:03,489 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1689865922966.a7da6f38e4e2dd9f3f1aabcb2d4297cd. service=AccessControlService 2023-07-20 15:12:03,490 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 15:12:03,490 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState a7da6f38e4e2dd9f3f1aabcb2d4297cd 2023-07-20 15:12:03,490 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689865922966.a7da6f38e4e2dd9f3f1aabcb2d4297cd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 15:12:03,490 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a7da6f38e4e2dd9f3f1aabcb2d4297cd 2023-07-20 15:12:03,490 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a7da6f38e4e2dd9f3f1aabcb2d4297cd 2023-07-20 15:12:03,490 DEBUG [StoreOpener-fa30491dfe1c0eb16bfd830b3ba58c58-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testEmptyExportFileSystemState/fa30491dfe1c0eb16bfd830b3ba58c58/cf 2023-07-20 15:12:03,491 DEBUG [StoreOpener-fa30491dfe1c0eb16bfd830b3ba58c58-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testEmptyExportFileSystemState/fa30491dfe1c0eb16bfd830b3ba58c58/cf 2023-07-20 15:12:03,491 INFO [StoreOpener-fa30491dfe1c0eb16bfd830b3ba58c58-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fa30491dfe1c0eb16bfd830b3ba58c58 columnFamilyName cf 2023-07-20 15:12:03,491 INFO [StoreOpener-a7da6f38e4e2dd9f3f1aabcb2d4297cd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a7da6f38e4e2dd9f3f1aabcb2d4297cd 2023-07-20 15:12:03,492 INFO [StoreOpener-fa30491dfe1c0eb16bfd830b3ba58c58-1] regionserver.HStore(310): Store=fa30491dfe1c0eb16bfd830b3ba58c58/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 15:12:03,492 DEBUG [StoreOpener-a7da6f38e4e2dd9f3f1aabcb2d4297cd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testEmptyExportFileSystemState/a7da6f38e4e2dd9f3f1aabcb2d4297cd/cf 2023-07-20 15:12:03,492 DEBUG [StoreOpener-a7da6f38e4e2dd9f3f1aabcb2d4297cd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testEmptyExportFileSystemState/a7da6f38e4e2dd9f3f1aabcb2d4297cd/cf 2023-07-20 15:12:03,493 INFO [StoreOpener-a7da6f38e4e2dd9f3f1aabcb2d4297cd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a7da6f38e4e2dd9f3f1aabcb2d4297cd columnFamilyName cf 2023-07-20 15:12:03,493 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testEmptyExportFileSystemState/fa30491dfe1c0eb16bfd830b3ba58c58 2023-07-20 15:12:03,493 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testEmptyExportFileSystemState/fa30491dfe1c0eb16bfd830b3ba58c58 2023-07-20 15:12:03,494 INFO [StoreOpener-a7da6f38e4e2dd9f3f1aabcb2d4297cd-1] regionserver.HStore(310): Store=a7da6f38e4e2dd9f3f1aabcb2d4297cd/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 15:12:03,495 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testEmptyExportFileSystemState/a7da6f38e4e2dd9f3f1aabcb2d4297cd 2023-07-20 15:12:03,495 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testEmptyExportFileSystemState/a7da6f38e4e2dd9f3f1aabcb2d4297cd 2023-07-20 15:12:03,496 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for fa30491dfe1c0eb16bfd830b3ba58c58 2023-07-20 15:12:03,497 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a7da6f38e4e2dd9f3f1aabcb2d4297cd 2023-07-20 15:12:03,498 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testEmptyExportFileSystemState/fa30491dfe1c0eb16bfd830b3ba58c58/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 15:12:03,499 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened fa30491dfe1c0eb16bfd830b3ba58c58; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71486346, jitterRate=0.06522956490516663}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 15:12:03,499 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for fa30491dfe1c0eb16bfd830b3ba58c58: 2023-07-20 15:12:03,500 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testEmptyExportFileSystemState/a7da6f38e4e2dd9f3f1aabcb2d4297cd/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 15:12:03,500 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1689865922966.fa30491dfe1c0eb16bfd830b3ba58c58., pid=93, masterSystemTime=1689865923480 2023-07-20 15:12:03,500 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a7da6f38e4e2dd9f3f1aabcb2d4297cd; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66927559, jitterRate=-0.0027016550302505493}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 15:12:03,500 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a7da6f38e4e2dd9f3f1aabcb2d4297cd: 2023-07-20 15:12:03,501 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1689865922966.a7da6f38e4e2dd9f3f1aabcb2d4297cd., pid=94, masterSystemTime=1689865923482 2023-07-20 15:12:03,502 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1689865922966.fa30491dfe1c0eb16bfd830b3ba58c58. 2023-07-20 15:12:03,502 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1689865922966.fa30491dfe1c0eb16bfd830b3ba58c58. 2023-07-20 15:12:03,503 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=fa30491dfe1c0eb16bfd830b3ba58c58, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:12:03,503 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1689865922966.a7da6f38e4e2dd9f3f1aabcb2d4297cd. 2023-07-20 15:12:03,503 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1689865922966.fa30491dfe1c0eb16bfd830b3ba58c58.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689865923502"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689865923502"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689865923502"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689865923502"}]},"ts":"1689865923502"} 2023-07-20 15:12:03,503 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1689865922966.a7da6f38e4e2dd9f3f1aabcb2d4297cd. 2023-07-20 15:12:03,503 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=a7da6f38e4e2dd9f3f1aabcb2d4297cd, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:12:03,503 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1689865922966.a7da6f38e4e2dd9f3f1aabcb2d4297cd.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689865923503"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689865923503"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689865923503"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689865923503"}]},"ts":"1689865923503"} 2023-07-20 15:12:03,506 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=92 2023-07-20 15:12:03,506 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=92, state=SUCCESS; OpenRegionProcedure fa30491dfe1c0eb16bfd830b3ba58c58, server=jenkins-hbase4.apache.org,41343,1689865822688 in 177 msec 2023-07-20 15:12:03,507 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=91 2023-07-20 15:12:03,507 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=91, state=SUCCESS; OpenRegionProcedure a7da6f38e4e2dd9f3f1aabcb2d4297cd, server=jenkins-hbase4.apache.org,37315,1689865822568 in 176 msec 2023-07-20 15:12:03,508 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=fa30491dfe1c0eb16bfd830b3ba58c58, ASSIGN in 346 msec 2023-07-20 15:12:03,509 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=91, resume processing ppid=90 2023-07-20 15:12:03,509 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=a7da6f38e4e2dd9f3f1aabcb2d4297cd, ASSIGN in 347 msec 2023-07-20 15:12:03,509 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-20 15:12:03,510 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689865923509"}]},"ts":"1689865923509"} 2023-07-20 15:12:03,511 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-07-20 15:12:03,513 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-20 15:12:03,513 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-07-20 15:12:03,515 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41343] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-20 15:12:03,520 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 15:12:03,520 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 15:12:03,520 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 15:12:03,520 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 15:12:03,523 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 555 msec 2023-07-20 15:12:03,526 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-20 15:12:03,526 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-20 15:12:03,526 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-20 15:12:03,526 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-20 15:12:03,577 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-20 15:12:03,577 INFO [Listener at jenkins-hbase4.apache.org/33267] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-07-20 15:12:03,580 DEBUG [Listener at jenkins-hbase4.apache.org/33267] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-20 15:12:03,580 DEBUG [Listener at jenkins-hbase4.apache.org/33267] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689865922966.a7da6f38e4e2dd9f3f1aabcb2d4297cd. 2023-07-20 15:12:03,582 INFO [Listener at jenkins-hbase4.apache.org/33267] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-20 15:12:03,597 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-20 15:12:03,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689865923597 (current time:1689865923597). 2023-07-20 15:12:03,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-20 15:12:03,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] zookeeper.ReadOnlyZKClient(139): Connect 0x0e882718 to 127.0.0.1:64446 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 15:12:03,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@320e7584, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 15:12:03,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 15:12:03,612 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53932, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 15:12:03,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0e882718 to 127.0.0.1:64446 2023-07-20 15:12:03,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 15:12:03,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] zookeeper.ReadOnlyZKClient(139): Connect 0x45391269 to 127.0.0.1:64446 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 15:12:03,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@ac65d31, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 15:12:03,627 DEBUG [hconnection-0x4ba5bbb8-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 15:12:03,630 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53946, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 15:12:03,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 15:12:03,639 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49070, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 15:12:03,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x45391269 to 127.0.0.1:64446 2023-07-20 15:12:03,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 15:12:03,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-20 15:12:03,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-20 15:12:03,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-20 15:12:03,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-20 15:12:03,645 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-20 15:12:03,645 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689866523645 2023-07-20 15:12:03,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-20 15:12:03,646 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-20 15:12:03,647 DEBUG [Listener at jenkins-hbase4.apache.org/33267] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-20 15:12:03,647 DEBUG [Listener at jenkins-hbase4.apache.org/33267] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-20 15:12:03,648 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-20 15:12:03,648 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-20 15:12:03,649 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 5 msec 2023-07-20 15:12:03,654 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-20 15:12:03,654 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689866523654 2023-07-20 15:12:03,667 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:03,667 INFO [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-07-20 15:12:03,667 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 15:12:03,669 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-20 15:12:03,669 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-20 15:12:03,670 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:03,670 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:03,675 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:12:03,675 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:12:03,675 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:12:03,675 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:12:03,675 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:12:03,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:12:03,675 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:12:03,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:12:03,675 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:12:03,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:12:03,678 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:12:03,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:03,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:03,678 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:12:03,678 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:03,679 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:03,679 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:12:03,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-20 15:12:03,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:03,679 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-20 15:12:03,679 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-20 15:12:03,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-20 15:12:03,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:03,679 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:03,680 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-20 15:12:03,680 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 15:12:03,680 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-20 15:12:03,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:03,680 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:03,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-20 15:12:03,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:03,681 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-20 15:12:03,682 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:03,683 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-20 15:12:03,683 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 15:12:03,686 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:03,686 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-20 15:12:03,686 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 15:12:03,688 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-20 15:12:03,688 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-20 15:12:03,688 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-20 15:12:03,688 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46155,1689865822636' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-20 15:12:03,688 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-20 15:12:03,688 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41343,1689865822688' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-20 15:12:03,688 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-20 15:12:03,689 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-20 15:12:03,689 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37315,1689865822568' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-20 15:12:03,690 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:03,691 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:03,692 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:03,692 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 15:12:03,692 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:03,692 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:03,692 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 15:12:03,692 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:03,692 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 15:12:03,695 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:12:03,695 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:12:03,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:12:03,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:12:03,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:12:03,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:12:03,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:12:03,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:03,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:12:03,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:12:03,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:12:03,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:12:03,697 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41343,1689865822688' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-20 15:12:03,697 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1160d926[Count = 1] remaining members to acquire global barrier 2023-07-20 15:12:03,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:12:03,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:12:03,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:12:03,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:12:03,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:12:03,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:03,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:12:03,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:12:03,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:12:03,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:12:03,699 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37315,1689865822568' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-20 15:12:03,700 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1160d926[Count = 0] remaining members to acquire global barrier 2023-07-20 15:12:03,700 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-20 15:12:03,700 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:03,702 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:03,702 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:03,702 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:03,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:03,702 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:03,702 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:12:03,702 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:03,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:03,702 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-20 15:12:03,702 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:03,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:03,702 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-20 15:12:03,702 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-20 15:12:03,702 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-20 15:12:03,702 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:12:03,702 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,46155,1689865822636' in zk 2023-07-20 15:12:03,702 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-20 15:12:03,703 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 15:12:03,703 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 15:12:03,703 DEBUG [rs(jenkins-hbase4.apache.org,37315,1689865822568)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689865922966.a7da6f38e4e2dd9f3f1aabcb2d4297cd. 2023-07-20 15:12:03,703 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 15:12:03,703 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 15:12:03,703 DEBUG [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689865922966.fa30491dfe1c0eb16bfd830b3ba58c58. 2023-07-20 15:12:03,703 DEBUG [rs(jenkins-hbase4.apache.org,37315,1689865822568)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689865922966.a7da6f38e4e2dd9f3f1aabcb2d4297cd. started... 2023-07-20 15:12:03,703 DEBUG [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689865922966.fa30491dfe1c0eb16bfd830b3ba58c58. started... 2023-07-20 15:12:03,705 DEBUG [rs(jenkins-hbase4.apache.org,37315,1689865822568)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a7da6f38e4e2dd9f3f1aabcb2d4297cd: 2023-07-20 15:12:03,705 DEBUG [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for fa30491dfe1c0eb16bfd830b3ba58c58: 2023-07-20 15:12:03,705 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-20 15:12:03,705 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 15:12:03,705 DEBUG [rs(jenkins-hbase4.apache.org,37315,1689865822568)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689865922966.a7da6f38e4e2dd9f3f1aabcb2d4297cd.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:03,705 DEBUG [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689865922966.fa30491dfe1c0eb16bfd830b3ba58c58.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:03,705 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-20 15:12:03,706 DEBUG [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 15:12:03,706 DEBUG [rs(jenkins-hbase4.apache.org,37315,1689865822568)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 15:12:03,706 DEBUG [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-20 15:12:03,707 DEBUG [rs(jenkins-hbase4.apache.org,37315,1689865822568)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-20 15:12:03,745 DEBUG [rs(jenkins-hbase4.apache.org,37315,1689865822568)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689865922966.a7da6f38e4e2dd9f3f1aabcb2d4297cd. completed. 2023-07-20 15:12:03,746 DEBUG [rs(jenkins-hbase4.apache.org,37315,1689865822568)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689865922966.a7da6f38e4e2dd9f3f1aabcb2d4297cd. 2023-07-20 15:12:03,746 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 15:12:03,746 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 15:12:03,746 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:12:03,746 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-20 15:12:03,746 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37315,1689865822568' in zk 2023-07-20 15:12:03,747 DEBUG [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689865922966.fa30491dfe1c0eb16bfd830b3ba58c58. completed. 2023-07-20 15:12:03,747 DEBUG [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689865922966.fa30491dfe1c0eb16bfd830b3ba58c58. 2023-07-20 15:12:03,747 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 15:12:03,747 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 15:12:03,747 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:12:03,747 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-20 15:12:03,747 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,41343,1689865822688' in zk 2023-07-20 15:12:03,747 DEBUG [Listener at jenkins-hbase4.apache.org/33267] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 15:12:03,749 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-20 15:12:03,749 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:12:03,749 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 15:12:03,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:12:03,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:12:03,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:12:03,749 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-20 15:12:03,750 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:12:03,750 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-20 15:12:03,751 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 15:12:03,751 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-20 15:12:03,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-20 15:12:03,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:12:03,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-20 15:12:03,752 DEBUG [Listener at jenkins-hbase4.apache.org/33267] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-20 15:12:03,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:12:03,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:03,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:12:03,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:12:03,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:12:03,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:12:03,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:03,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:12:03,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:12:03,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:12:03,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,37315,1689865822568': 2023-07-20 15:12:03,756 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37315,1689865822568' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-20 15:12:03,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:12:03,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:12:03,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:12:03,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:12:03,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:12:03,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:03,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:12:03,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:12:03,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:12:03,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:12:03,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:03,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:12:03,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:12:03,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:12:03,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,41343,1689865822688': 2023-07-20 15:12:03,763 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41343,1689865822688' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-20 15:12:03,763 INFO [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-07-20 15:12:03,763 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-20 15:12:03,763 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-20 15:12:03,763 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:03,763 INFO [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-20 15:12:03,769 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:03,770 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:03,770 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:03,770 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:12:03,770 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:03,770 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:03,770 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:03,770 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:03,770 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:12:03,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:03,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:03,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:12:03,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:12:03,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:03,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:03,770 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:12:03,770 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:12:03,770 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:12:03,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:12:03,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:12:03,771 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:12:03,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:12:03,771 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:12:03,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:12:03,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:03,771 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:12:03,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:03,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:03,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:03,772 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:12:03,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:12:03,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:03,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:12:03,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:12:03,776 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:12:03,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:12:03,777 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:12:03,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:12:03,777 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:12:03,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:03,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:12:03,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:12:03,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:12:03,781 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:12:03,781 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:03,781 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:12:03,782 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:03,782 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:12:03,781 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:12:03,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:12:03,782 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:12:03,782 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:12:03,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:12:03,782 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-07-20 15:12:03,782 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:03,782 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-20 15:12:03,782 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:12:03,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:12:03,782 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:12:03,781 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 15:12:03,782 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:12:03,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:12:03,781 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:12:03,783 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:12:03,783 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:03,783 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:12:03,783 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:03,783 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:12:03,784 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-20 15:12:03,785 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:12:03,784 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:12:03,785 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:03,785 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:12:03,785 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:03,785 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:12:03,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:12:03,786 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:12:03,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:12:03,826 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:03,826 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:03,852 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:03,876 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-20 15:12:03,876 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:03,876 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:03,876 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689865923646Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1689865923826 (+180 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689865923826Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1689865923826Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1689865923830 (+4 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689865923845 (+15 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689865923876 (+31 ms) 2023-07-20 15:12:03,880 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-20 15:12:03,882 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 233 msec 2023-07-20 15:12:03,953 DEBUG [Listener at jenkins-hbase4.apache.org/33267] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 15:12:03,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-20 15:12:03,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-20 15:12:03,956 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37315] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1689865922966.a7da6f38e4e2dd9f3f1aabcb2d4297cd. with WAL disabled. Data may be lost in the event of a crash. 2023-07-20 15:12:03,957 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41343] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1689865922966.fa30491dfe1c0eb16bfd830b3ba58c58. with WAL disabled. Data may be lost in the event of a crash. 2023-07-20 15:12:03,960 DEBUG [Listener at jenkins-hbase4.apache.org/33267] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-20 15:12:03,960 DEBUG [Listener at jenkins-hbase4.apache.org/33267] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689865922966.a7da6f38e4e2dd9f3f1aabcb2d4297cd. 2023-07-20 15:12:03,961 INFO [Listener at jenkins-hbase4.apache.org/33267] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-20 15:12:03,970 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-20 15:12:03,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689865923970 (current time:1689865923970). 2023-07-20 15:12:03,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-20 15:12:03,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] zookeeper.ReadOnlyZKClient(139): Connect 0x6842c7b7 to 127.0.0.1:64446 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 15:12:03,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@e5cd97c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 15:12:03,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 15:12:03,983 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53948, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 15:12:03,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6842c7b7 to 127.0.0.1:64446 2023-07-20 15:12:03,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 15:12:03,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] zookeeper.ReadOnlyZKClient(139): Connect 0x3c15a889 to 127.0.0.1:64446 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 15:12:04,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4294bfc3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 15:12:04,007 DEBUG [hconnection-0x2a6b19d4-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 15:12:04,008 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53962, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 15:12:04,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 15:12:04,013 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49078, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 15:12:04,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3c15a889 to 127.0.0.1:64446 2023-07-20 15:12:04,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 15:12:04,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-20 15:12:04,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-20 15:12:04,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-20 15:12:04,018 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-20 15:12:04,022 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-20 15:12:04,027 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689866524027 2023-07-20 15:12:04,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-20 15:12:04,027 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-20 15:12:04,029 DEBUG [Listener at jenkins-hbase4.apache.org/33267] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-20 15:12:04,029 DEBUG [Listener at jenkins-hbase4.apache.org/33267] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-20 15:12:04,030 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-20 15:12:04,030 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-20 15:12:04,031 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 13 msec 2023-07-20 15:12:04,032 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-20 15:12:04,033 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689866524033 2023-07-20 15:12:04,059 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,060 INFO [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-07-20 15:12:04,060 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 15:12:04,061 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-20 15:12:04,061 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-20 15:12:04,062 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,062 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,067 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:12:04,067 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:12:04,067 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:12:04,067 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:12:04,067 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:12:04,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:12:04,067 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:12:04,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:12:04,067 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:12:04,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:12:04,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,076 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,076 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:12:04,076 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:12:04,076 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,077 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:12:04,077 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-20 15:12:04,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-20 15:12:04,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,077 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-20 15:12:04,077 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-20 15:12:04,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,078 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-20 15:12:04,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-20 15:12:04,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,078 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-20 15:12:04,078 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,079 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,079 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-20 15:12:04,079 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 15:12:04,079 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-20 15:12:04,079 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 15:12:04,079 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,081 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-20 15:12:04,081 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-20 15:12:04,081 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-20 15:12:04,081 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-20 15:12:04,081 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37315,1689865822568' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-20 15:12:04,081 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-20 15:12:04,081 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46155,1689865822636' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-20 15:12:04,081 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 15:12:04,086 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-20 15:12:04,086 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-20 15:12:04,086 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41343,1689865822688' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-20 15:12:04,089 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,089 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:12:04,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:12:04,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:12:04,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:12:04,090 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:12:04,091 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,091 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,091 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 15:12:04,091 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,091 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 15:12:04,092 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:12:04,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:12:04,092 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,092 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 15:12:04,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:12:04,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:12:04,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:12:04,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:12:04,094 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37315,1689865822568' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-20 15:12:04,095 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7ccbf9cf[Count = 1] remaining members to acquire global barrier 2023-07-20 15:12:04,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:12:04,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:12:04,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:12:04,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:12:04,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:12:04,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:12:04,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:12:04,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:12:04,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:12:04,101 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41343,1689865822688' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-20 15:12:04,101 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7ccbf9cf[Count = 0] remaining members to acquire global barrier 2023-07-20 15:12:04,101 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-20 15:12:04,101 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,107 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,107 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,107 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,107 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,107 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,107 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,107 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-20 15:12:04,107 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-20 15:12:04,107 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-20 15:12:04,107 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,46155,1689865822636' in zk 2023-07-20 15:12:04,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,108 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-20 15:12:04,108 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:12:04,109 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 15:12:04,109 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 15:12:04,109 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:12:04,109 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-20 15:12:04,109 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 15:12:04,109 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 15:12:04,109 DEBUG [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689865922966.fa30491dfe1c0eb16bfd830b3ba58c58. 2023-07-20 15:12:04,109 DEBUG [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689865922966.fa30491dfe1c0eb16bfd830b3ba58c58. started... 2023-07-20 15:12:04,110 INFO [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] regionserver.HRegion(2745): Flushing fa30491dfe1c0eb16bfd830b3ba58c58 1/1 column families, dataSize=2.87 KB heapSize=6.44 KB 2023-07-20 15:12:04,110 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-20 15:12:04,110 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 15:12:04,110 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-20 15:12:04,117 DEBUG [rs(jenkins-hbase4.apache.org,37315,1689865822568)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689865922966.a7da6f38e4e2dd9f3f1aabcb2d4297cd. 2023-07-20 15:12:04,118 DEBUG [rs(jenkins-hbase4.apache.org,37315,1689865822568)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689865922966.a7da6f38e4e2dd9f3f1aabcb2d4297cd. started... 2023-07-20 15:12:04,118 INFO [rs(jenkins-hbase4.apache.org,37315,1689865822568)-snapshot-pool-0] regionserver.HRegion(2745): Flushing a7da6f38e4e2dd9f3f1aabcb2d4297cd 1/1 column families, dataSize=400 B heapSize=1.09 KB 2023-07-20 15:12:04,129 DEBUG [Listener at jenkins-hbase4.apache.org/33267] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 15:12:04,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-20 15:12:04,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-20 15:12:04,130 DEBUG [Listener at jenkins-hbase4.apache.org/33267] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-20 15:12:04,151 INFO [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230720bff1f1616b1e4e8f9fe5011860257e60 to hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230720bff1f1616b1e4e8f9fe5011860257e60 2023-07-20 15:12:04,164 INFO [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testEmptyExportFileSystemState/fa30491dfe1c0eb16bfd830b3ba58c58/.tmp/cf/4182fb3141e54fc1b8001432bd70c800 2023-07-20 15:12:04,164 INFO [rs(jenkins-hbase4.apache.org,37315,1689865822568)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230720f0fdcadcc8374950a409e63c2379f523 to hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230720f0fdcadcc8374950a409e63c2379f523 2023-07-20 15:12:04,169 DEBUG [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testEmptyExportFileSystemState/fa30491dfe1c0eb16bfd830b3ba58c58/.tmp/cf/4182fb3141e54fc1b8001432bd70c800 as hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testEmptyExportFileSystemState/fa30491dfe1c0eb16bfd830b3ba58c58/cf/4182fb3141e54fc1b8001432bd70c800 2023-07-20 15:12:04,172 INFO [rs(jenkins-hbase4.apache.org,37315,1689865822568)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=400, hasBloomFilter=true, into tmp file hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testEmptyExportFileSystemState/a7da6f38e4e2dd9f3f1aabcb2d4297cd/.tmp/cf/c5af26af95e54ae9aab52b9a9636aa39 2023-07-20 15:12:04,174 INFO [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testEmptyExportFileSystemState/fa30491dfe1c0eb16bfd830b3ba58c58/cf/4182fb3141e54fc1b8001432bd70c800, entries=44, sequenceid=6, filesize=12.6 K 2023-07-20 15:12:04,175 INFO [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.87 KB/2936, heapSize ~6.42 KB/6576, currentSize=0 B/0 for fa30491dfe1c0eb16bfd830b3ba58c58 in 66ms, sequenceid=6, compaction requested=false 2023-07-20 15:12:04,176 DEBUG [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-20 15:12:04,176 DEBUG [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for fa30491dfe1c0eb16bfd830b3ba58c58: 2023-07-20 15:12:04,176 DEBUG [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689865922966.fa30491dfe1c0eb16bfd830b3ba58c58.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,178 DEBUG [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 15:12:04,179 DEBUG [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testEmptyExportFileSystemState/fa30491dfe1c0eb16bfd830b3ba58c58/cf/4182fb3141e54fc1b8001432bd70c800] hfiles 2023-07-20 15:12:04,179 DEBUG [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testEmptyExportFileSystemState/fa30491dfe1c0eb16bfd830b3ba58c58/cf/4182fb3141e54fc1b8001432bd70c800 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,180 DEBUG [rs(jenkins-hbase4.apache.org,37315,1689865822568)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testEmptyExportFileSystemState/a7da6f38e4e2dd9f3f1aabcb2d4297cd/.tmp/cf/c5af26af95e54ae9aab52b9a9636aa39 as hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testEmptyExportFileSystemState/a7da6f38e4e2dd9f3f1aabcb2d4297cd/cf/c5af26af95e54ae9aab52b9a9636aa39 2023-07-20 15:12:04,186 INFO [rs(jenkins-hbase4.apache.org,37315,1689865822568)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testEmptyExportFileSystemState/a7da6f38e4e2dd9f3f1aabcb2d4297cd/cf/c5af26af95e54ae9aab52b9a9636aa39, entries=6, sequenceid=6, filesize=5.9 K 2023-07-20 15:12:04,196 INFO [rs(jenkins-hbase4.apache.org,37315,1689865822568)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~400 B/400, heapSize ~1.08 KB/1104, currentSize=0 B/0 for a7da6f38e4e2dd9f3f1aabcb2d4297cd in 78ms, sequenceid=6, compaction requested=false 2023-07-20 15:12:04,198 DEBUG [rs(jenkins-hbase4.apache.org,37315,1689865822568)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a7da6f38e4e2dd9f3f1aabcb2d4297cd: 2023-07-20 15:12:04,198 DEBUG [rs(jenkins-hbase4.apache.org,37315,1689865822568)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689865922966.a7da6f38e4e2dd9f3f1aabcb2d4297cd.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,198 DEBUG [rs(jenkins-hbase4.apache.org,37315,1689865822568)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 15:12:04,198 DEBUG [rs(jenkins-hbase4.apache.org,37315,1689865822568)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testEmptyExportFileSystemState/a7da6f38e4e2dd9f3f1aabcb2d4297cd/cf/c5af26af95e54ae9aab52b9a9636aa39] hfiles 2023-07-20 15:12:04,198 DEBUG [rs(jenkins-hbase4.apache.org,37315,1689865822568)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testEmptyExportFileSystemState/a7da6f38e4e2dd9f3f1aabcb2d4297cd/cf/c5af26af95e54ae9aab52b9a9636aa39 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,226 DEBUG [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689865922966.fa30491dfe1c0eb16bfd830b3ba58c58. completed. 2023-07-20 15:12:04,227 DEBUG [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689865922966.fa30491dfe1c0eb16bfd830b3ba58c58. 2023-07-20 15:12:04,227 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 15:12:04,227 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 15:12:04,227 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:12:04,227 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-20 15:12:04,227 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,41343,1689865822688' in zk 2023-07-20 15:12:04,231 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-20 15:12:04,231 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:12:04,231 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 15:12:04,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:12:04,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:12:04,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:12:04,231 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-20 15:12:04,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:12:04,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:12:04,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:12:04,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:12:04,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:12:04,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:12:04,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:12:04,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:12:04,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,41343,1689865822688': 2023-07-20 15:12:04,237 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41343,1689865822688' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-20 15:12:04,256 DEBUG [rs(jenkins-hbase4.apache.org,37315,1689865822568)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689865922966.a7da6f38e4e2dd9f3f1aabcb2d4297cd. completed. 2023-07-20 15:12:04,256 DEBUG [rs(jenkins-hbase4.apache.org,37315,1689865822568)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689865922966.a7da6f38e4e2dd9f3f1aabcb2d4297cd. 2023-07-20 15:12:04,256 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 15:12:04,256 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 15:12:04,256 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:12:04,256 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-20 15:12:04,256 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37315,1689865822568' in zk 2023-07-20 15:12:04,258 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:12:04,258 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-20 15:12:04,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:12:04,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:12:04,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:12:04,258 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 15:12:04,258 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-20 15:12:04,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:12:04,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:12:04,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:12:04,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:12:04,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:12:04,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:12:04,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:12:04,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:12:04,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:12:04,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,37315,1689865822568': 2023-07-20 15:12:04,264 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37315,1689865822568' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-20 15:12:04,264 INFO [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-07-20 15:12:04,264 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-20 15:12:04,264 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-20 15:12:04,264 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,264 INFO [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-20 15:12:04,266 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,266 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,266 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,266 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,266 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:12:04,266 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,266 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:12:04,266 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:12:04,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:12:04,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,266 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,266 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:12:04,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:12:04,267 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:12:04,267 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:12:04,267 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:12:04,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:12:04,267 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:12:04,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:12:04,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:12:04,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,267 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:12:04,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:12:04,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,268 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:12:04,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:12:04,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:12:04,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:12:04,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:12:04,269 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:12:04,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,270 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:12:04,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:12:04,270 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:12:04,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:12:04,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:12:04,273 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:12:04,273 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:12:04,273 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:12:04,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:12:04,273 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,273 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:12:04,274 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:12:04,274 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:12:04,274 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 15:12:04,274 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:12:04,274 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:12:04,274 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,274 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:12:04,274 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:12:04,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:12:04,274 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:12:04,274 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:12:04,274 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:12:04,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:12:04,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:12:04,274 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-07-20 15:12:04,274 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,274 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,274 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:12:04,275 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:12:04,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:12:04,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:12:04,275 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-20 15:12:04,274 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:12:04,275 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,275 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:12:04,275 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:12:04,277 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,277 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,277 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230720bff1f1616b1e4e8f9fe5011860257e60, hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230720f0fdcadcc8374950a409e63c2379f523] mob files 2023-07-20 15:12:04,277 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230720bff1f1616b1e4e8f9fe5011860257e60 2023-07-20 15:12:04,277 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230720f0fdcadcc8374950a409e63c2379f523 2023-07-20 15:12:04,305 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,306 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,331 DEBUG [Listener at jenkins-hbase4.apache.org/33267] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 15:12:04,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-20 15:12:04,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-20 15:12:04,332 DEBUG [Listener at jenkins-hbase4.apache.org/33267] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-20 15:12:04,334 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,358 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-20 15:12:04,358 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,358 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,358 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689865924027Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1689865924305 (+278 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1689865924305Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1689865924305Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1689865924309 (+4 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1689865924326 (+17 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689865924358 (+32 ms) 2023-07-20 15:12:04,362 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-20 15:12:04,364 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 334 msec 2023-07-20 15:12:04,632 DEBUG [Listener at jenkins-hbase4.apache.org/33267] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 15:12:04,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-20 15:12:04,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-20 15:12:04,634 INFO [Listener at jenkins-hbase4.apache.org/33267] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/export-test/export-1689865924634 2023-07-20 15:12:04,634 INFO [Listener at jenkins-hbase4.apache.org/33267] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:42063, tgtDir=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/export-test/export-1689865924634, rawTgtDir=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/export-test/export-1689865924634, srcFsUri=hdfs://localhost:42063, srcDir=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b 2023-07-20 15:12:04,663 DEBUG [Listener at jenkins-hbase4.apache.org/33267] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:42063, inputRoot=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b 2023-07-20 15:12:04,663 DEBUG [Listener at jenkins-hbase4.apache.org/33267] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1868373635_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/export-test/export-1689865924634, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/export-test/export-1689865924634/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,663 INFO [Listener at jenkins-hbase4.apache.org/33267] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:42063, inputRoot=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b, snapshotDir=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-07-20 15:12:04,670 INFO [Listener at jenkins-hbase4.apache.org/33267] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/export-test/export-1689865924634/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,794 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-20 15:12:04,794 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-20 15:12:04,795 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-20 15:12:04,796 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-20 15:12:04,796 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-20 15:12:04,796 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-20 15:12:04,797 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-20 15:12:04,892 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a3c136b5-559e-274b-8286-a02c66f74c8f/hadoop-6942227372915159055.jar 2023-07-20 15:12:04,892 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-20 15:12:04,893 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-20 15:12:04,893 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-20 15:12:04,893 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-20 15:12:04,894 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-20 15:12:04,894 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-20 15:12:04,894 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-20 15:12:04,895 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-20 15:12:04,895 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-20 15:12:04,896 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-20 15:12:04,896 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-20 15:12:04,896 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-20 15:12:04,897 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-20 15:12:04,897 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-20 15:12:04,897 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-20 15:12:04,898 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-20 15:12:04,898 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 15:12:04,898 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 15:12:04,899 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 15:12:04,899 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 15:12:04,899 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 15:12:04,900 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 15:12:04,900 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 15:12:06,501 WARN [Listener at jenkins-hbase4.apache.org/33267] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-20 15:12:06,504 INFO [Listener at jenkins-hbase4.apache.org/33267] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-07-20 15:12:07,093 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-20 15:12:07,093 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-20 15:12:07,108 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689865830265_0005_000001 (auth:SIMPLE) 2023-07-20 15:12:07,626 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689865830265_0006_000001 (auth:SIMPLE) 2023-07-20 15:12:07,814 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-20 15:12:14,525 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689865830265_0006_000001 (auth:SIMPLE) 2023-07-20 15:12:17,005 INFO [Listener at jenkins-hbase4.apache.org/33267] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-20 15:12:17,010 INFO [Listener at jenkins-hbase4.apache.org/33267] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-20 15:12:17,020 INFO [Listener at jenkins-hbase4.apache.org/33267] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:17,020 INFO [Listener at jenkins-hbase4.apache.org/33267] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-20 15:12:17,021 INFO [Listener at jenkins-hbase4.apache.org/33267] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-20 15:12:17,021 DEBUG [Listener at jenkins-hbase4.apache.org/33267] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_478830040_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:17,022 DEBUG [Listener at jenkins-hbase4.apache.org/33267] snapshot.TestExportSnapshot(367): hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-20 15:12:17,022 DEBUG [Listener at jenkins-hbase4.apache.org/33267] snapshot.TestExportSnapshot(367): hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-20 15:12:17,022 DEBUG [Listener at jenkins-hbase4.apache.org/33267] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_478830040_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/export-test/export-1689865924634/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/export-test/export-1689865924634/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:17,022 DEBUG [Listener at jenkins-hbase4.apache.org/33267] snapshot.TestExportSnapshot(367): hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/export-test/export-1689865924634/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-20 15:12:17,022 DEBUG [Listener at jenkins-hbase4.apache.org/33267] snapshot.TestExportSnapshot(367): hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/export-test/export-1689865924634/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-20 15:12:17,029 INFO [Listener at jenkins-hbase4.apache.org/33267] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-07-20 15:12:17,030 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-07-20 15:12:17,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] procedure2.ProcedureExecutor(1029): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-20 15:12:17,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-20 15:12:17,035 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689865937035"}]},"ts":"1689865937035"} 2023-07-20 15:12:17,037 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-07-20 15:12:17,038 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-07-20 15:12:17,039 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=a7da6f38e4e2dd9f3f1aabcb2d4297cd, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=fa30491dfe1c0eb16bfd830b3ba58c58, UNASSIGN}] 2023-07-20 15:12:17,044 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=a7da6f38e4e2dd9f3f1aabcb2d4297cd, UNASSIGN 2023-07-20 15:12:17,044 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=fa30491dfe1c0eb16bfd830b3ba58c58, UNASSIGN 2023-07-20 15:12:17,045 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=a7da6f38e4e2dd9f3f1aabcb2d4297cd, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:12:17,045 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689865922966.a7da6f38e4e2dd9f3f1aabcb2d4297cd.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689865937045"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689865937045"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689865937045"}]},"ts":"1689865937045"} 2023-07-20 15:12:17,046 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=fa30491dfe1c0eb16bfd830b3ba58c58, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:12:17,046 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689865922966.fa30491dfe1c0eb16bfd830b3ba58c58.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689865937046"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689865937046"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689865937046"}]},"ts":"1689865937046"} 2023-07-20 15:12:17,048 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; CloseRegionProcedure a7da6f38e4e2dd9f3f1aabcb2d4297cd, server=jenkins-hbase4.apache.org,37315,1689865822568}] 2023-07-20 15:12:17,049 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=101, state=RUNNABLE; CloseRegionProcedure fa30491dfe1c0eb16bfd830b3ba58c58, server=jenkins-hbase4.apache.org,41343,1689865822688}] 2023-07-20 15:12:17,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-20 15:12:17,200 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close a7da6f38e4e2dd9f3f1aabcb2d4297cd 2023-07-20 15:12:17,201 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a7da6f38e4e2dd9f3f1aabcb2d4297cd, disabling compactions & flushes 2023-07-20 15:12:17,201 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689865922966.a7da6f38e4e2dd9f3f1aabcb2d4297cd. 2023-07-20 15:12:17,201 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689865922966.a7da6f38e4e2dd9f3f1aabcb2d4297cd. 2023-07-20 15:12:17,201 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689865922966.a7da6f38e4e2dd9f3f1aabcb2d4297cd. after waiting 0 ms 2023-07-20 15:12:17,201 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689865922966.a7da6f38e4e2dd9f3f1aabcb2d4297cd. 2023-07-20 15:12:17,201 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close fa30491dfe1c0eb16bfd830b3ba58c58 2023-07-20 15:12:17,206 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing fa30491dfe1c0eb16bfd830b3ba58c58, disabling compactions & flushes 2023-07-20 15:12:17,206 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689865922966.fa30491dfe1c0eb16bfd830b3ba58c58. 2023-07-20 15:12:17,206 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689865922966.fa30491dfe1c0eb16bfd830b3ba58c58. 2023-07-20 15:12:17,206 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689865922966.fa30491dfe1c0eb16bfd830b3ba58c58. after waiting 0 ms 2023-07-20 15:12:17,206 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689865922966.fa30491dfe1c0eb16bfd830b3ba58c58. 2023-07-20 15:12:17,216 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testEmptyExportFileSystemState/a7da6f38e4e2dd9f3f1aabcb2d4297cd/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-20 15:12:17,217 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testEmptyExportFileSystemState/fa30491dfe1c0eb16bfd830b3ba58c58/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-20 15:12:17,217 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 15:12:17,218 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689865922966.a7da6f38e4e2dd9f3f1aabcb2d4297cd. 2023-07-20 15:12:17,218 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a7da6f38e4e2dd9f3f1aabcb2d4297cd: 2023-07-20 15:12:17,218 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 15:12:17,219 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689865922966.fa30491dfe1c0eb16bfd830b3ba58c58. 2023-07-20 15:12:17,219 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for fa30491dfe1c0eb16bfd830b3ba58c58: 2023-07-20 15:12:17,221 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed a7da6f38e4e2dd9f3f1aabcb2d4297cd 2023-07-20 15:12:17,224 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=a7da6f38e4e2dd9f3f1aabcb2d4297cd, regionState=CLOSED 2023-07-20 15:12:17,224 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689865922966.a7da6f38e4e2dd9f3f1aabcb2d4297cd.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689865937224"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689865937224"}]},"ts":"1689865937224"} 2023-07-20 15:12:17,225 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed fa30491dfe1c0eb16bfd830b3ba58c58 2023-07-20 15:12:17,231 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=fa30491dfe1c0eb16bfd830b3ba58c58, regionState=CLOSED 2023-07-20 15:12:17,231 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689865922966.fa30491dfe1c0eb16bfd830b3ba58c58.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689865937231"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689865937231"}]},"ts":"1689865937231"} 2023-07-20 15:12:17,232 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=100 2023-07-20 15:12:17,232 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=100, state=SUCCESS; CloseRegionProcedure a7da6f38e4e2dd9f3f1aabcb2d4297cd, server=jenkins-hbase4.apache.org,37315,1689865822568 in 178 msec 2023-07-20 15:12:17,234 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=a7da6f38e4e2dd9f3f1aabcb2d4297cd, UNASSIGN in 193 msec 2023-07-20 15:12:17,234 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=101 2023-07-20 15:12:17,235 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=101, state=SUCCESS; CloseRegionProcedure fa30491dfe1c0eb16bfd830b3ba58c58, server=jenkins-hbase4.apache.org,41343,1689865822688 in 184 msec 2023-07-20 15:12:17,239 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=101, resume processing ppid=99 2023-07-20 15:12:17,239 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=fa30491dfe1c0eb16bfd830b3ba58c58, UNASSIGN in 196 msec 2023-07-20 15:12:17,240 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689865937240"}]},"ts":"1689865937240"} 2023-07-20 15:12:17,241 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-07-20 15:12:17,243 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-07-20 15:12:17,245 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 214 msec 2023-07-20 15:12:17,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-20 15:12:17,338 INFO [Listener at jenkins-hbase4.apache.org/33267] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-07-20 15:12:17,338 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-07-20 15:12:17,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-20 15:12:17,342 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-20 15:12:17,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-07-20 15:12:17,343 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-20 15:12:17,345 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41343] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-07-20 15:12:17,348 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testEmptyExportFileSystemState/fa30491dfe1c0eb16bfd830b3ba58c58 2023-07-20 15:12:17,348 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testEmptyExportFileSystemState/a7da6f38e4e2dd9f3f1aabcb2d4297cd 2023-07-20 15:12:17,350 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-20 15:12:17,350 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-20 15:12:17,350 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-20 15:12:17,350 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-20 15:12:17,351 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-20 15:12:17,351 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-20 15:12:17,351 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-20 15:12:17,351 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-20 15:12:17,351 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testEmptyExportFileSystemState/fa30491dfe1c0eb16bfd830b3ba58c58/cf, FileablePath, hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testEmptyExportFileSystemState/fa30491dfe1c0eb16bfd830b3ba58c58/recovered.edits] 2023-07-20 15:12:17,352 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testEmptyExportFileSystemState/a7da6f38e4e2dd9f3f1aabcb2d4297cd/cf, FileablePath, hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testEmptyExportFileSystemState/a7da6f38e4e2dd9f3f1aabcb2d4297cd/recovered.edits] 2023-07-20 15:12:17,352 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-20 15:12:17,352 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 15:12:17,352 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-20 15:12:17,352 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 15:12:17,352 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-20 15:12:17,352 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 15:12:17,352 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-20 15:12:17,353 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 15:12:17,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-20 15:12:17,357 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testEmptyExportFileSystemState/fa30491dfe1c0eb16bfd830b3ba58c58/cf/4182fb3141e54fc1b8001432bd70c800 to hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/archive/data/default/testtb-testEmptyExportFileSystemState/fa30491dfe1c0eb16bfd830b3ba58c58/cf/4182fb3141e54fc1b8001432bd70c800 2023-07-20 15:12:17,357 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testEmptyExportFileSystemState/a7da6f38e4e2dd9f3f1aabcb2d4297cd/cf/c5af26af95e54ae9aab52b9a9636aa39 to hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/archive/data/default/testtb-testEmptyExportFileSystemState/a7da6f38e4e2dd9f3f1aabcb2d4297cd/cf/c5af26af95e54ae9aab52b9a9636aa39 2023-07-20 15:12:17,362 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testEmptyExportFileSystemState/fa30491dfe1c0eb16bfd830b3ba58c58/recovered.edits/9.seqid to hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/archive/data/default/testtb-testEmptyExportFileSystemState/fa30491dfe1c0eb16bfd830b3ba58c58/recovered.edits/9.seqid 2023-07-20 15:12:17,362 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testEmptyExportFileSystemState/fa30491dfe1c0eb16bfd830b3ba58c58 2023-07-20 15:12:17,364 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testEmptyExportFileSystemState/a7da6f38e4e2dd9f3f1aabcb2d4297cd/recovered.edits/9.seqid to hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/archive/data/default/testtb-testEmptyExportFileSystemState/a7da6f38e4e2dd9f3f1aabcb2d4297cd/recovered.edits/9.seqid 2023-07-20 15:12:17,364 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testEmptyExportFileSystemState/a7da6f38e4e2dd9f3f1aabcb2d4297cd 2023-07-20 15:12:17,364 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-20 15:12:17,365 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-07-20 15:12:17,366 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-07-20 15:12:17,370 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230720bff1f1616b1e4e8f9fe5011860257e60 to hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230720bff1f1616b1e4e8f9fe5011860257e60 2023-07-20 15:12:17,372 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230720f0fdcadcc8374950a409e63c2379f523 to hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230720f0fdcadcc8374950a409e63c2379f523 2023-07-20 15:12:17,373 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-07-20 15:12:17,375 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-20 15:12:17,383 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-07-20 15:12:17,385 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-07-20 15:12:17,388 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-20 15:12:17,388 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-07-20 15:12:17,388 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1689865922966.a7da6f38e4e2dd9f3f1aabcb2d4297cd.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689865937388"}]},"ts":"9223372036854775807"} 2023-07-20 15:12:17,388 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1689865922966.fa30491dfe1c0eb16bfd830b3ba58c58.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689865937388"}]},"ts":"9223372036854775807"} 2023-07-20 15:12:17,391 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-20 15:12:17,391 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => a7da6f38e4e2dd9f3f1aabcb2d4297cd, NAME => 'testtb-testEmptyExportFileSystemState,,1689865922966.a7da6f38e4e2dd9f3f1aabcb2d4297cd.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => fa30491dfe1c0eb16bfd830b3ba58c58, NAME => 'testtb-testEmptyExportFileSystemState,1,1689865922966.fa30491dfe1c0eb16bfd830b3ba58c58.', STARTKEY => '1', ENDKEY => ''}] 2023-07-20 15:12:17,391 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-07-20 15:12:17,391 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689865937391"}]},"ts":"9223372036854775807"} 2023-07-20 15:12:17,396 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-07-20 15:12:17,398 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-20 15:12:17,399 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 59 msec 2023-07-20 15:12:17,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-20 15:12:17,455 INFO [Listener at jenkins-hbase4.apache.org/33267] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-07-20 15:12:17,464 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-07-20 15:12:17,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:17,468 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-07-20 15:12:17,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:17,505 INFO [Listener at jenkins-hbase4.apache.org/33267] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=760 (was 757) Potentially hanging thread: Thread-4781 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x3c085ba2-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-581168119_1 at /127.0.0.1:60134 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3c085ba2-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1484284473) connection to jenkins-hbase4.apache.org/172.31.14.131:40623 from appattempt_1689865830265_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-581168119_1 at /127.0.0.1:56228 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3c085ba2-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_478830040_17 at /127.0.0.1:60158 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1484284473) connection to jenkins-hbase4.apache.org/172.31.14.131:40335 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (1484284473) connection to jenkins-hbase4.apache.org/172.31.14.131:33267 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3c085ba2-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_478830040_17 at /127.0.0.1:52286 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_478830040_17 at /127.0.0.1:56252 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=910 (was 907) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=653 (was 562) - SystemLoadAverage LEAK? -, ProcessCount=185 (was 185), AvailableMemoryMB=2058 (was 2740) 2023-07-20 15:12:17,505 WARN [Listener at jenkins-hbase4.apache.org/33267] hbase.ResourceChecker(130): Thread=760 is superior to 500 2023-07-20 15:12:17,533 INFO [Listener at jenkins-hbase4.apache.org/33267] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=760, OpenFileDescriptor=910, MaxFileDescriptor=60000, SystemLoadAverage=653, ProcessCount=185, AvailableMemoryMB=2056 2023-07-20 15:12:17,533 WARN [Listener at jenkins-hbase4.apache.org/33267] hbase.ResourceChecker(130): Thread=760 is superior to 500 2023-07-20 15:12:17,536 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-20 15:12:17,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:17,540 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-07-20 15:12:17,540 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-07-20 15:12:17,541 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-20 15:12:17,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-20 15:12:17,544 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/562e13dad1e37a397190ef2ce91b2c6e 2023-07-20 15:12:17,544 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/850ac635c6d75464c9459a49b686fcaa 2023-07-20 15:12:17,544 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/562e13dad1e37a397190ef2ce91b2c6e empty. 2023-07-20 15:12:17,544 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/850ac635c6d75464c9459a49b686fcaa empty. 2023-07-20 15:12:17,545 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/562e13dad1e37a397190ef2ce91b2c6e 2023-07-20 15:12:17,545 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/850ac635c6d75464c9459a49b686fcaa 2023-07-20 15:12:17,545 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-20 15:12:17,568 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-07-20 15:12:17,570 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => 562e13dad1e37a397190ef2ce91b2c6e, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689865937535.562e13dad1e37a397190ef2ce91b2c6e.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp 2023-07-20 15:12:17,571 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 850ac635c6d75464c9459a49b686fcaa, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689865937535.850ac635c6d75464c9459a49b686fcaa.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp 2023-07-20 15:12:17,607 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689865937535.562e13dad1e37a397190ef2ce91b2c6e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 15:12:17,607 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing 562e13dad1e37a397190ef2ce91b2c6e, disabling compactions & flushes 2023-07-20 15:12:17,607 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689865937535.562e13dad1e37a397190ef2ce91b2c6e. 2023-07-20 15:12:17,607 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689865937535.562e13dad1e37a397190ef2ce91b2c6e. 2023-07-20 15:12:17,607 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689865937535.562e13dad1e37a397190ef2ce91b2c6e. after waiting 0 ms 2023-07-20 15:12:17,607 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689865937535.562e13dad1e37a397190ef2ce91b2c6e. 2023-07-20 15:12:17,607 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689865937535.562e13dad1e37a397190ef2ce91b2c6e. 2023-07-20 15:12:17,607 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for 562e13dad1e37a397190ef2ce91b2c6e: 2023-07-20 15:12:17,623 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689865937535.850ac635c6d75464c9459a49b686fcaa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 15:12:17,623 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 850ac635c6d75464c9459a49b686fcaa, disabling compactions & flushes 2023-07-20 15:12:17,623 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689865937535.850ac635c6d75464c9459a49b686fcaa. 2023-07-20 15:12:17,623 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689865937535.850ac635c6d75464c9459a49b686fcaa. 2023-07-20 15:12:17,624 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689865937535.850ac635c6d75464c9459a49b686fcaa. after waiting 0 ms 2023-07-20 15:12:17,624 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689865937535.850ac635c6d75464c9459a49b686fcaa. 2023-07-20 15:12:17,624 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689865937535.850ac635c6d75464c9459a49b686fcaa. 2023-07-20 15:12:17,624 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 850ac635c6d75464c9459a49b686fcaa: 2023-07-20 15:12:17,627 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-07-20 15:12:17,629 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689865937535.562e13dad1e37a397190ef2ce91b2c6e.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689865937628"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689865937628"}]},"ts":"1689865937628"} 2023-07-20 15:12:17,629 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689865937535.850ac635c6d75464c9459a49b686fcaa.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689865937628"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689865937628"}]},"ts":"1689865937628"} 2023-07-20 15:12:17,631 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-20 15:12:17,632 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-20 15:12:17,632 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689865937632"}]},"ts":"1689865937632"} 2023-07-20 15:12:17,633 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-07-20 15:12:17,637 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-20 15:12:17,639 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-20 15:12:17,639 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-20 15:12:17,639 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-20 15:12:17,639 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-20 15:12:17,639 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=562e13dad1e37a397190ef2ce91b2c6e, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=850ac635c6d75464c9459a49b686fcaa, ASSIGN}] 2023-07-20 15:12:17,642 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=562e13dad1e37a397190ef2ce91b2c6e, ASSIGN 2023-07-20 15:12:17,642 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=850ac635c6d75464c9459a49b686fcaa, ASSIGN 2023-07-20 15:12:17,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-20 15:12:17,643 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=562e13dad1e37a397190ef2ce91b2c6e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37315,1689865822568; forceNewPlan=false, retain=false 2023-07-20 15:12:17,643 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=850ac635c6d75464c9459a49b686fcaa, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41343,1689865822688; forceNewPlan=false, retain=false 2023-07-20 15:12:17,793 INFO [jenkins-hbase4:38949] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-20 15:12:17,797 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=850ac635c6d75464c9459a49b686fcaa, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:12:17,797 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=562e13dad1e37a397190ef2ce91b2c6e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:12:17,797 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689865937535.850ac635c6d75464c9459a49b686fcaa.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689865937797"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689865937797"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689865937797"}]},"ts":"1689865937797"} 2023-07-20 15:12:17,797 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689865937535.562e13dad1e37a397190ef2ce91b2c6e.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689865937797"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689865937797"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689865937797"}]},"ts":"1689865937797"} 2023-07-20 15:12:17,800 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=108, ppid=107, state=RUNNABLE; OpenRegionProcedure 850ac635c6d75464c9459a49b686fcaa, server=jenkins-hbase4.apache.org,41343,1689865822688}] 2023-07-20 15:12:17,800 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=106, state=RUNNABLE; OpenRegionProcedure 562e13dad1e37a397190ef2ce91b2c6e, server=jenkins-hbase4.apache.org,37315,1689865822568}] 2023-07-20 15:12:17,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-20 15:12:17,955 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1689865937535.850ac635c6d75464c9459a49b686fcaa. 2023-07-20 15:12:17,955 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1689865937535.562e13dad1e37a397190ef2ce91b2c6e. 2023-07-20 15:12:17,955 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 850ac635c6d75464c9459a49b686fcaa, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689865937535.850ac635c6d75464c9459a49b686fcaa.', STARTKEY => '1', ENDKEY => ''} 2023-07-20 15:12:17,955 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 562e13dad1e37a397190ef2ce91b2c6e, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689865937535.562e13dad1e37a397190ef2ce91b2c6e.', STARTKEY => '', ENDKEY => '1'} 2023-07-20 15:12:17,956 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1689865937535.562e13dad1e37a397190ef2ce91b2c6e. service=AccessControlService 2023-07-20 15:12:17,956 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1689865937535.850ac635c6d75464c9459a49b686fcaa. service=AccessControlService 2023-07-20 15:12:17,956 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 15:12:17,956 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 15:12:17,956 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 562e13dad1e37a397190ef2ce91b2c6e 2023-07-20 15:12:17,956 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 850ac635c6d75464c9459a49b686fcaa 2023-07-20 15:12:17,956 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689865937535.562e13dad1e37a397190ef2ce91b2c6e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 15:12:17,956 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689865937535.850ac635c6d75464c9459a49b686fcaa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 15:12:17,956 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 562e13dad1e37a397190ef2ce91b2c6e 2023-07-20 15:12:17,956 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 850ac635c6d75464c9459a49b686fcaa 2023-07-20 15:12:17,956 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 562e13dad1e37a397190ef2ce91b2c6e 2023-07-20 15:12:17,956 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 850ac635c6d75464c9459a49b686fcaa 2023-07-20 15:12:17,958 INFO [StoreOpener-562e13dad1e37a397190ef2ce91b2c6e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 562e13dad1e37a397190ef2ce91b2c6e 2023-07-20 15:12:17,959 INFO [StoreOpener-850ac635c6d75464c9459a49b686fcaa-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 850ac635c6d75464c9459a49b686fcaa 2023-07-20 15:12:17,960 DEBUG [StoreOpener-562e13dad1e37a397190ef2ce91b2c6e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportFileSystemStateWithSkipTmp/562e13dad1e37a397190ef2ce91b2c6e/cf 2023-07-20 15:12:17,961 DEBUG [StoreOpener-562e13dad1e37a397190ef2ce91b2c6e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportFileSystemStateWithSkipTmp/562e13dad1e37a397190ef2ce91b2c6e/cf 2023-07-20 15:12:17,961 DEBUG [StoreOpener-850ac635c6d75464c9459a49b686fcaa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportFileSystemStateWithSkipTmp/850ac635c6d75464c9459a49b686fcaa/cf 2023-07-20 15:12:17,961 DEBUG [StoreOpener-850ac635c6d75464c9459a49b686fcaa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportFileSystemStateWithSkipTmp/850ac635c6d75464c9459a49b686fcaa/cf 2023-07-20 15:12:17,961 INFO [StoreOpener-562e13dad1e37a397190ef2ce91b2c6e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 562e13dad1e37a397190ef2ce91b2c6e columnFamilyName cf 2023-07-20 15:12:17,961 INFO [StoreOpener-850ac635c6d75464c9459a49b686fcaa-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 850ac635c6d75464c9459a49b686fcaa columnFamilyName cf 2023-07-20 15:12:17,963 INFO [StoreOpener-850ac635c6d75464c9459a49b686fcaa-1] regionserver.HStore(310): Store=850ac635c6d75464c9459a49b686fcaa/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 15:12:17,963 INFO [StoreOpener-562e13dad1e37a397190ef2ce91b2c6e-1] regionserver.HStore(310): Store=562e13dad1e37a397190ef2ce91b2c6e/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 15:12:17,964 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportFileSystemStateWithSkipTmp/562e13dad1e37a397190ef2ce91b2c6e 2023-07-20 15:12:17,964 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportFileSystemStateWithSkipTmp/850ac635c6d75464c9459a49b686fcaa 2023-07-20 15:12:17,965 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportFileSystemStateWithSkipTmp/562e13dad1e37a397190ef2ce91b2c6e 2023-07-20 15:12:17,965 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportFileSystemStateWithSkipTmp/850ac635c6d75464c9459a49b686fcaa 2023-07-20 15:12:17,968 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 562e13dad1e37a397190ef2ce91b2c6e 2023-07-20 15:12:17,968 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 850ac635c6d75464c9459a49b686fcaa 2023-07-20 15:12:17,970 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportFileSystemStateWithSkipTmp/562e13dad1e37a397190ef2ce91b2c6e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 15:12:17,970 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportFileSystemStateWithSkipTmp/850ac635c6d75464c9459a49b686fcaa/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 15:12:17,970 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 850ac635c6d75464c9459a49b686fcaa; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67654581, jitterRate=0.008131816983222961}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 15:12:17,970 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 562e13dad1e37a397190ef2ce91b2c6e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71240295, jitterRate=0.061563119292259216}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 15:12:17,970 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 850ac635c6d75464c9459a49b686fcaa: 2023-07-20 15:12:17,970 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 562e13dad1e37a397190ef2ce91b2c6e: 2023-07-20 15:12:17,971 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1689865937535.850ac635c6d75464c9459a49b686fcaa., pid=108, masterSystemTime=1689865937952 2023-07-20 15:12:17,971 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1689865937535.562e13dad1e37a397190ef2ce91b2c6e., pid=109, masterSystemTime=1689865937952 2023-07-20 15:12:17,974 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1689865937535.850ac635c6d75464c9459a49b686fcaa. 2023-07-20 15:12:17,974 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1689865937535.850ac635c6d75464c9459a49b686fcaa. 2023-07-20 15:12:17,974 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1689865937535.562e13dad1e37a397190ef2ce91b2c6e. 2023-07-20 15:12:17,974 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1689865937535.562e13dad1e37a397190ef2ce91b2c6e. 2023-07-20 15:12:17,974 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=850ac635c6d75464c9459a49b686fcaa, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:12:17,974 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689865937535.850ac635c6d75464c9459a49b686fcaa.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689865937974"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689865937974"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689865937974"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689865937974"}]},"ts":"1689865937974"} 2023-07-20 15:12:17,975 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=562e13dad1e37a397190ef2ce91b2c6e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:12:17,975 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689865937535.562e13dad1e37a397190ef2ce91b2c6e.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689865937975"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689865937975"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689865937975"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689865937975"}]},"ts":"1689865937975"} 2023-07-20 15:12:17,978 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=107 2023-07-20 15:12:17,978 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=107, state=SUCCESS; OpenRegionProcedure 850ac635c6d75464c9459a49b686fcaa, server=jenkins-hbase4.apache.org,41343,1689865822688 in 177 msec 2023-07-20 15:12:17,980 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=106 2023-07-20 15:12:17,980 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=106, state=SUCCESS; OpenRegionProcedure 562e13dad1e37a397190ef2ce91b2c6e, server=jenkins-hbase4.apache.org,37315,1689865822568 in 177 msec 2023-07-20 15:12:17,983 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=850ac635c6d75464c9459a49b686fcaa, ASSIGN in 339 msec 2023-07-20 15:12:17,984 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=106, resume processing ppid=105 2023-07-20 15:12:17,985 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=562e13dad1e37a397190ef2ce91b2c6e, ASSIGN in 341 msec 2023-07-20 15:12:17,985 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-20 15:12:17,985 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689865937985"}]},"ts":"1689865937985"} 2023-07-20 15:12:17,987 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-07-20 15:12:17,992 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-07-20 15:12:17,992 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-07-20 15:12:17,994 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41343] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-20 15:12:17,997 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 15:12:17,997 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 15:12:17,997 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 15:12:17,997 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 15:12:18,003 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,003 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-20 15:12:18,003 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-20 15:12:18,003 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-20 15:12:18,004 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-20 15:12:18,005 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 467 msec 2023-07-20 15:12:18,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-20 15:12:18,146 INFO [Listener at jenkins-hbase4.apache.org/33267] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-07-20 15:12:18,148 DEBUG [Listener at jenkins-hbase4.apache.org/33267] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,148 DEBUG [Listener at jenkins-hbase4.apache.org/33267] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689865937535.562e13dad1e37a397190ef2ce91b2c6e. 2023-07-20 15:12:18,150 INFO [Listener at jenkins-hbase4.apache.org/33267] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-20 15:12:18,165 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-20 15:12:18,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689865938165 (current time:1689865938165). 2023-07-20 15:12:18,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-20 15:12:18,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] zookeeper.ReadOnlyZKClient(139): Connect 0x7e505740 to 127.0.0.1:64446 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 15:12:18,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1e41e180, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 15:12:18,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 15:12:18,180 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33142, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 15:12:18,181 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7e505740 to 127.0.0.1:64446 2023-07-20 15:12:18,181 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 15:12:18,181 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] zookeeper.ReadOnlyZKClient(139): Connect 0x5bd10e4d to 127.0.0.1:64446 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 15:12:18,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2747b820, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 15:12:18,188 DEBUG [hconnection-0x369b10a9-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 15:12:18,191 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33144, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 15:12:18,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 15:12:18,197 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39266, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 15:12:18,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5bd10e4d to 127.0.0.1:64446 2023-07-20 15:12:18,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 15:12:18,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-20 15:12:18,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-20 15:12:18,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-20 15:12:18,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] procedure2.ProcedureExecutor(1029): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-20 15:12:18,203 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-20 15:12:18,203 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689866538203 2023-07-20 15:12:18,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-20 15:12:18,203 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,205 DEBUG [Listener at jenkins-hbase4.apache.org/33267] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-20 15:12:18,205 DEBUG [Listener at jenkins-hbase4.apache.org/33267] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-20 15:12:18,205 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-20 15:12:18,206 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-20 15:12:18,207 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 5 msec 2023-07-20 15:12:18,208 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-20 15:12:18,209 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689866538209 2023-07-20 15:12:18,223 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,223 INFO [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-20 15:12:18,223 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 15:12:18,225 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-20 15:12:18,225 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-20 15:12:18,303 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,303 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,304 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:12:18,304 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:12:18,304 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:12:18,304 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:12:18,304 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:12:18,304 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:12:18,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:12:18,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:12:18,304 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:12:18,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:12:18,305 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:12:18,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,305 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:12:18,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,305 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,305 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,305 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:12:18,305 DEBUG [Listener at jenkins-hbase4.apache.org/33267] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 15:12:18,305 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-20 15:12:18,305 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-20 15:12:18,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-20 15:12:18,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,306 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-20 15:12:18,306 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-20 15:12:18,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-20 15:12:18,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,306 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,306 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-20 15:12:18,306 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,306 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-20 15:12:18,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-20 15:12:18,306 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 15:12:18,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-20 15:12:18,306 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-20 15:12:18,306 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,307 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 15:12:18,308 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-20 15:12:18,309 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-20 15:12:18,309 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-20 15:12:18,307 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-20 15:12:18,309 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-20 15:12:18,309 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41343,1689865822688' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-20 15:12:18,309 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46155,1689865822636' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-20 15:12:18,309 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 15:12:18,309 DEBUG [Listener at jenkins-hbase4.apache.org/33267] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-20 15:12:18,310 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-20 15:12:18,310 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-20 15:12:18,310 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37315,1689865822568' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-20 15:12:18,317 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:12:18,317 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:12:18,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:12:18,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:12:18,317 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,317 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,317 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:12:18,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:12:18,317 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 15:12:18,317 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,317 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,318 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 15:12:18,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:12:18,318 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,318 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 15:12:18,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:12:18,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:12:18,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:12:18,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:12:18,319 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41343,1689865822688' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-20 15:12:18,319 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@19a25dca[Count = 1] remaining members to acquire global barrier 2023-07-20 15:12:18,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:12:18,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:12:18,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:12:18,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:12:18,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:12:18,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:12:18,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:12:18,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:12:18,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:12:18,321 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37315,1689865822568' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-20 15:12:18,321 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@19a25dca[Count = 0] remaining members to acquire global barrier 2023-07-20 15:12:18,321 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-20 15:12:18,321 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,322 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,322 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,322 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,322 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,322 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,323 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:12:18,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,323 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,323 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-20 15:12:18,323 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:12:18,323 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 15:12:18,323 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 15:12:18,323 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-20 15:12:18,323 DEBUG [rs(jenkins-hbase4.apache.org,37315,1689865822568)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689865937535.562e13dad1e37a397190ef2ce91b2c6e. 2023-07-20 15:12:18,323 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-20 15:12:18,323 DEBUG [rs(jenkins-hbase4.apache.org,37315,1689865822568)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689865937535.562e13dad1e37a397190ef2ce91b2c6e. started... 2023-07-20 15:12:18,323 DEBUG [rs(jenkins-hbase4.apache.org,37315,1689865822568)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 562e13dad1e37a397190ef2ce91b2c6e: 2023-07-20 15:12:18,324 DEBUG [rs(jenkins-hbase4.apache.org,37315,1689865822568)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689865937535.562e13dad1e37a397190ef2ce91b2c6e.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,324 DEBUG [rs(jenkins-hbase4.apache.org,37315,1689865822568)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 15:12:18,324 DEBUG [rs(jenkins-hbase4.apache.org,37315,1689865822568)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-20 15:12:18,326 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-20 15:12:18,326 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-20 15:12:18,327 DEBUG [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689865937535.850ac635c6d75464c9459a49b686fcaa. 2023-07-20 15:12:18,326 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 15:12:18,327 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 15:12:18,327 DEBUG [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689865937535.850ac635c6d75464c9459a49b686fcaa. started... 2023-07-20 15:12:18,327 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,46155,1689865822636' in zk 2023-07-20 15:12:18,328 DEBUG [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 850ac635c6d75464c9459a49b686fcaa: 2023-07-20 15:12:18,329 DEBUG [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689865937535.850ac635c6d75464c9459a49b686fcaa.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,329 DEBUG [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 15:12:18,329 DEBUG [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-20 15:12:18,332 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-20 15:12:18,332 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 15:12:18,332 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-20 15:12:18,348 DEBUG [rs(jenkins-hbase4.apache.org,37315,1689865822568)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689865937535.562e13dad1e37a397190ef2ce91b2c6e. completed. 2023-07-20 15:12:18,348 DEBUG [rs(jenkins-hbase4.apache.org,37315,1689865822568)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689865937535.562e13dad1e37a397190ef2ce91b2c6e. 2023-07-20 15:12:18,348 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 15:12:18,348 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 15:12:18,348 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:12:18,348 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-20 15:12:18,348 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,37315,1689865822568' in zk 2023-07-20 15:12:18,355 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:12:18,355 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-20 15:12:18,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:12:18,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:12:18,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:12:18,355 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 15:12:18,355 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-20 15:12:18,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:12:18,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:12:18,357 DEBUG [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689865937535.850ac635c6d75464c9459a49b686fcaa. completed. 2023-07-20 15:12:18,357 DEBUG [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689865937535.850ac635c6d75464c9459a49b686fcaa. 2023-07-20 15:12:18,357 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 15:12:18,357 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 15:12:18,357 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:12:18,357 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-20 15:12:18,357 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,41343,1689865822688' in zk 2023-07-20 15:12:18,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:12:18,359 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:12:18,359 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-20 15:12:18,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:12:18,359 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 15:12:18,359 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-20 15:12:18,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:12:18,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:12:18,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:12:18,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:12:18,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:12:18,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,37315,1689865822568': 2023-07-20 15:12:18,362 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37315,1689865822568' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-20 15:12:18,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:12:18,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:12:18,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:12:18,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:12:18,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:12:18,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:12:18,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:12:18,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:12:18,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:12:18,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:12:18,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:12:18,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:12:18,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,41343,1689865822688': 2023-07-20 15:12:18,365 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41343,1689865822688' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-20 15:12:18,365 INFO [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-20 15:12:18,365 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-20 15:12:18,365 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-20 15:12:18,365 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,365 INFO [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-20 15:12:18,367 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,367 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,367 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,367 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,367 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:12:18,367 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:12:18,367 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,367 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:12:18,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:12:18,367 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:12:18,367 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,367 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:12:18,368 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:12:18,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:12:18,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:12:18,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:12:18,368 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:12:18,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,368 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:12:18,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:12:18,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,368 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:12:18,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,369 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:12:18,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:12:18,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:12:18,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:12:18,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:12:18,370 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:12:18,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:12:18,371 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:12:18,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,371 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:12:18,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:12:18,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:12:18,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:12:18,375 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:12:18,375 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,375 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:12:18,375 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,375 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:12:18,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:12:18,375 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:12:18,375 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 15:12:18,375 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:12:18,375 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:12:18,375 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:12:18,376 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:12:18,376 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:12:18,376 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:12:18,376 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:12:18,376 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:12:18,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:12:18,375 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:12:18,375 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,377 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:12:18,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:12:18,377 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,377 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:12:18,377 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-20 15:12:18,377 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:12:18,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:12:18,377 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,377 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:12:18,377 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:12:18,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:12:18,377 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:12:18,377 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,377 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,378 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-20 15:12:18,385 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,386 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,401 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,433 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-20 15:12:18,433 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,433 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,433 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689865938204Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1689865938385 (+181 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689865938385Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689865938385Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689865938388 (+3 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689865938395 (+7 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689865938433 (+38 ms) 2023-07-20 15:12:18,436 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-20 15:12:18,437 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 231 msec 2023-07-20 15:12:18,510 DEBUG [Listener at jenkins-hbase4.apache.org/33267] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 15:12:18,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-20 15:12:18,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-20 15:12:18,513 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37315] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1689865937535.562e13dad1e37a397190ef2ce91b2c6e. with WAL disabled. Data may be lost in the event of a crash. 2023-07-20 15:12:18,514 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41343] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1689865937535.850ac635c6d75464c9459a49b686fcaa. with WAL disabled. Data may be lost in the event of a crash. 2023-07-20 15:12:18,516 DEBUG [Listener at jenkins-hbase4.apache.org/33267] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,516 DEBUG [Listener at jenkins-hbase4.apache.org/33267] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689865937535.562e13dad1e37a397190ef2ce91b2c6e. 2023-07-20 15:12:18,516 INFO [Listener at jenkins-hbase4.apache.org/33267] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-20 15:12:18,525 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-20 15:12:18,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689865938525 (current time:1689865938525). 2023-07-20 15:12:18,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-20 15:12:18,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] zookeeper.ReadOnlyZKClient(139): Connect 0x23a064ac to 127.0.0.1:64446 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 15:12:18,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4dd02629, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 15:12:18,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 15:12:18,533 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33146, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 15:12:18,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x23a064ac to 127.0.0.1:64446 2023-07-20 15:12:18,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 15:12:18,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] zookeeper.ReadOnlyZKClient(139): Connect 0x18364c5e to 127.0.0.1:64446 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 15:12:18,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3893cef0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 15:12:18,541 DEBUG [hconnection-0x74be46a5-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 15:12:18,543 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33150, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 15:12:18,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 15:12:18,549 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39274, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 15:12:18,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x18364c5e to 127.0.0.1:64446 2023-07-20 15:12:18,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 15:12:18,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-20 15:12:18,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-20 15:12:18,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-20 15:12:18,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-20 15:12:18,553 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-20 15:12:18,554 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689866538554 2023-07-20 15:12:18,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-20 15:12:18,554 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,555 DEBUG [Listener at jenkins-hbase4.apache.org/33267] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-20 15:12:18,555 DEBUG [Listener at jenkins-hbase4.apache.org/33267] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-20 15:12:18,556 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-20 15:12:18,557 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-20 15:12:18,559 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 6 msec 2023-07-20 15:12:18,560 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-20 15:12:18,560 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689866538560 2023-07-20 15:12:18,569 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,569 INFO [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-20 15:12:18,569 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 15:12:18,571 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-20 15:12:18,571 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-20 15:12:18,655 DEBUG [Listener at jenkins-hbase4.apache.org/33267] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 15:12:18,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-20 15:12:18,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-20 15:12:18,657 DEBUG [Listener at jenkins-hbase4.apache.org/33267] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-20 15:12:18,657 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,657 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,660 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:12:18,660 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:12:18,660 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:12:18,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:12:18,660 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:12:18,660 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:12:18,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:12:18,661 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:12:18,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:12:18,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,660 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:12:18,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,661 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,662 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-20 15:12:18,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,662 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:12:18,662 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:12:18,662 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-20 15:12:18,662 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-20 15:12:18,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,662 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:12:18,662 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-20 15:12:18,662 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-20 15:12:18,663 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-20 15:12:18,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,663 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-20 15:12:18,663 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 15:12:18,663 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-20 15:12:18,664 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,666 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-20 15:12:18,666 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-20 15:12:18,666 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-20 15:12:18,666 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37315,1689865822568' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-20 15:12:18,666 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 15:12:18,666 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,668 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-20 15:12:18,668 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-20 15:12:18,668 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-20 15:12:18,668 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 15:12:18,668 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41343,1689865822688' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-20 15:12:18,669 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-20 15:12:18,669 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-20 15:12:18,669 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46155,1689865822636' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-20 15:12:18,671 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:12:18,671 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:12:18,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:12:18,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:12:18,672 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:12:18,672 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:12:18,673 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,673 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,674 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 15:12:18,674 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 15:12:18,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:12:18,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:12:18,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:12:18,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:12:18,676 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:12:18,677 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,677 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 15:12:18,677 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37315,1689865822568' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-20 15:12:18,677 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2455b9d6[Count = 1] remaining members to acquire global barrier 2023-07-20 15:12:18,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:12:18,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:12:18,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:12:18,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:12:18,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:12:18,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:12:18,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:12:18,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:12:18,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:12:18,680 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41343,1689865822688' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-20 15:12:18,680 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2455b9d6[Count = 0] remaining members to acquire global barrier 2023-07-20 15:12:18,680 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-20 15:12:18,680 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,684 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,684 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,684 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,684 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,684 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,684 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,685 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-20 15:12:18,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,685 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:12:18,685 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-20 15:12:18,685 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-20 15:12:18,685 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-20 15:12:18,685 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,46155,1689865822636' in zk 2023-07-20 15:12:18,685 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:12:18,685 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-20 15:12:18,685 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 15:12:18,686 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 15:12:18,686 DEBUG [rs(jenkins-hbase4.apache.org,37315,1689865822568)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689865937535.562e13dad1e37a397190ef2ce91b2c6e. 2023-07-20 15:12:18,686 DEBUG [rs(jenkins-hbase4.apache.org,37315,1689865822568)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689865937535.562e13dad1e37a397190ef2ce91b2c6e. started... 2023-07-20 15:12:18,686 INFO [rs(jenkins-hbase4.apache.org,37315,1689865822568)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 562e13dad1e37a397190ef2ce91b2c6e 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-20 15:12:18,686 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-20 15:12:18,686 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 15:12:18,686 DEBUG [member: 'jenkins-hbase4.apache.org,46155,1689865822636' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-20 15:12:18,690 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 15:12:18,692 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 15:12:18,692 DEBUG [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689865937535.850ac635c6d75464c9459a49b686fcaa. 2023-07-20 15:12:18,692 DEBUG [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689865937535.850ac635c6d75464c9459a49b686fcaa. started... 2023-07-20 15:12:18,693 INFO [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 850ac635c6d75464c9459a49b686fcaa 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-20 15:12:18,742 INFO [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307203130a3a55df14eb99e823894962571d4 to hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202307203130a3a55df14eb99e823894962571d4 2023-07-20 15:12:18,743 INFO [rs(jenkins-hbase4.apache.org,37315,1689865822568)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307208d188d11a45e4790b2021d1e0dae8892 to hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202307208d188d11a45e4790b2021d1e0dae8892 2023-07-20 15:12:18,763 INFO [rs(jenkins-hbase4.apache.org,37315,1689865822568)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportFileSystemStateWithSkipTmp/562e13dad1e37a397190ef2ce91b2c6e/.tmp/cf/acf7f582d78243ed955375bf644e43e0 2023-07-20 15:12:18,769 DEBUG [rs(jenkins-hbase4.apache.org,37315,1689865822568)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportFileSystemStateWithSkipTmp/562e13dad1e37a397190ef2ce91b2c6e/.tmp/cf/acf7f582d78243ed955375bf644e43e0 as hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportFileSystemStateWithSkipTmp/562e13dad1e37a397190ef2ce91b2c6e/cf/acf7f582d78243ed955375bf644e43e0 2023-07-20 15:12:18,771 INFO [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportFileSystemStateWithSkipTmp/850ac635c6d75464c9459a49b686fcaa/.tmp/cf/b2c633d9f7814d3b81cb8bbe469401b5 2023-07-20 15:12:18,775 INFO [rs(jenkins-hbase4.apache.org,37315,1689865822568)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportFileSystemStateWithSkipTmp/562e13dad1e37a397190ef2ce91b2c6e/cf/acf7f582d78243ed955375bf644e43e0, entries=3, sequenceid=6, filesize=5.4 K 2023-07-20 15:12:18,776 DEBUG [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportFileSystemStateWithSkipTmp/850ac635c6d75464c9459a49b686fcaa/.tmp/cf/b2c633d9f7814d3b81cb8bbe469401b5 as hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportFileSystemStateWithSkipTmp/850ac635c6d75464c9459a49b686fcaa/cf/b2c633d9f7814d3b81cb8bbe469401b5 2023-07-20 15:12:18,776 INFO [rs(jenkins-hbase4.apache.org,37315,1689865822568)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 562e13dad1e37a397190ef2ce91b2c6e in 90ms, sequenceid=6, compaction requested=false 2023-07-20 15:12:18,776 DEBUG [rs(jenkins-hbase4.apache.org,37315,1689865822568)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-20 15:12:18,777 DEBUG [rs(jenkins-hbase4.apache.org,37315,1689865822568)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 562e13dad1e37a397190ef2ce91b2c6e: 2023-07-20 15:12:18,777 DEBUG [rs(jenkins-hbase4.apache.org,37315,1689865822568)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689865937535.562e13dad1e37a397190ef2ce91b2c6e.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,777 DEBUG [rs(jenkins-hbase4.apache.org,37315,1689865822568)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 15:12:18,778 DEBUG [rs(jenkins-hbase4.apache.org,37315,1689865822568)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportFileSystemStateWithSkipTmp/562e13dad1e37a397190ef2ce91b2c6e/cf/acf7f582d78243ed955375bf644e43e0] hfiles 2023-07-20 15:12:18,778 DEBUG [rs(jenkins-hbase4.apache.org,37315,1689865822568)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportFileSystemStateWithSkipTmp/562e13dad1e37a397190ef2ce91b2c6e/cf/acf7f582d78243ed955375bf644e43e0 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,789 INFO [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportFileSystemStateWithSkipTmp/850ac635c6d75464c9459a49b686fcaa/cf/b2c633d9f7814d3b81cb8bbe469401b5, entries=47, sequenceid=6, filesize=13.3 K 2023-07-20 15:12:18,790 INFO [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 850ac635c6d75464c9459a49b686fcaa in 97ms, sequenceid=6, compaction requested=false 2023-07-20 15:12:18,792 DEBUG [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 850ac635c6d75464c9459a49b686fcaa: 2023-07-20 15:12:18,792 DEBUG [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689865937535.850ac635c6d75464c9459a49b686fcaa.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,792 DEBUG [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 15:12:18,792 DEBUG [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportFileSystemStateWithSkipTmp/850ac635c6d75464c9459a49b686fcaa/cf/b2c633d9f7814d3b81cb8bbe469401b5] hfiles 2023-07-20 15:12:18,792 DEBUG [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportFileSystemStateWithSkipTmp/850ac635c6d75464c9459a49b686fcaa/cf/b2c633d9f7814d3b81cb8bbe469401b5 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,819 DEBUG [rs(jenkins-hbase4.apache.org,37315,1689865822568)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689865937535.562e13dad1e37a397190ef2ce91b2c6e. completed. 2023-07-20 15:12:18,819 DEBUG [rs(jenkins-hbase4.apache.org,37315,1689865822568)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689865937535.562e13dad1e37a397190ef2ce91b2c6e. 2023-07-20 15:12:18,819 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 15:12:18,819 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 15:12:18,819 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:12:18,819 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-20 15:12:18,819 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,37315,1689865822568' in zk 2023-07-20 15:12:18,821 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:12:18,821 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-20 15:12:18,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:12:18,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:12:18,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:12:18,821 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 15:12:18,821 DEBUG [member: 'jenkins-hbase4.apache.org,37315,1689865822568' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-20 15:12:18,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:12:18,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:12:18,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:12:18,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:12:18,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:12:18,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:12:18,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:12:18,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:12:18,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,37315,1689865822568': 2023-07-20 15:12:18,828 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37315,1689865822568' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-20 15:12:18,849 DEBUG [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689865937535.850ac635c6d75464c9459a49b686fcaa. completed. 2023-07-20 15:12:18,849 DEBUG [rs(jenkins-hbase4.apache.org,41343,1689865822688)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689865937535.850ac635c6d75464c9459a49b686fcaa. 2023-07-20 15:12:18,849 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 15:12:18,849 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 15:12:18,849 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:12:18,849 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-20 15:12:18,849 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,41343,1689865822688' in zk 2023-07-20 15:12:18,851 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:12:18,851 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-20 15:12:18,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:12:18,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:12:18,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:12:18,851 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 15:12:18,851 DEBUG [member: 'jenkins-hbase4.apache.org,41343,1689865822688' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-20 15:12:18,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:12:18,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:12:18,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:12:18,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:12:18,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:12:18,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:12:18,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:12:18,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:12:18,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:12:18,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,41343,1689865822688': 2023-07-20 15:12:18,857 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41343,1689865822688' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-20 15:12:18,857 INFO [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-20 15:12:18,857 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-20 15:12:18,857 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-20 15:12:18,857 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,857 INFO [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-20 15:12:18,857 DEBUG [Listener at jenkins-hbase4.apache.org/33267] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 15:12:18,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-20 15:12:18,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-20 15:12:18,858 DEBUG [Listener at jenkins-hbase4.apache.org/33267] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-20 15:12:18,860 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,860 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,860 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,860 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,860 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,860 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:12:18,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,860 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,860 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:12:18,860 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,860 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:12:18,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:12:18,861 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:12:18,861 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:12:18,861 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:12:18,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:12:18,861 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:12:18,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:12:18,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:12:18,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:12:18,861 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:12:18,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:12:18,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,862 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:12:18,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:12:18,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:12:18,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:12:18,865 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:12:18,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:12:18,866 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:12:18,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:12:18,866 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:12:18,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:12:18,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:12:18,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:12:18,871 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:12:18,871 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,871 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:12:18,871 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:12:18,871 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:12:18,871 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,871 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:12:18,871 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:12:18,871 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:12:18,871 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,871 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:12:18,871 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,871 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:12:18,871 DEBUG [(jenkins-hbase4.apache.org,38949,1689865821097)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 15:12:18,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:12:18,871 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:12:18,873 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:12:18,871 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:12:18,873 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-20 15:12:18,873 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:12:18,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:12:18,873 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:12:18,873 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,873 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:12:18,873 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:12:18,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:12:18,873 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:12:18,873 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:12:18,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:12:18,873 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,874 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,874 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:12:18,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:12:18,874 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202307203130a3a55df14eb99e823894962571d4, hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202307208d188d11a45e4790b2021d1e0dae8892] mob files 2023-07-20 15:12:18,874 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202307203130a3a55df14eb99e823894962571d4 2023-07-20 15:12:18,874 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202307208d188d11a45e4790b2021d1e0dae8892 2023-07-20 15:12:18,881 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,881 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,913 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,939 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-20 15:12:18,939 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,940 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,940 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689865938554Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1689865938881 (+327 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689865938881Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1689865938881Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1689865938887 (+6 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689865938901 (+14 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689865938939 (+38 ms) 2023-07-20 15:12:18,943 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-20 15:12:18,944 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 388 msec 2023-07-20 15:12:19,159 DEBUG [Listener at jenkins-hbase4.apache.org/33267] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 15:12:19,159 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-20 15:12:19,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-20 15:12:19,160 INFO [Listener at jenkins-hbase4.apache.org/33267] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/export-test/export-1689865939160 2023-07-20 15:12:19,160 INFO [Listener at jenkins-hbase4.apache.org/33267] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:42063, tgtDir=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/export-test/export-1689865939160, rawTgtDir=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/export-test/export-1689865939160, srcFsUri=hdfs://localhost:42063, srcDir=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b 2023-07-20 15:12:19,183 DEBUG [Listener at jenkins-hbase4.apache.org/33267] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:42063, inputRoot=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b 2023-07-20 15:12:19,183 DEBUG [Listener at jenkins-hbase4.apache.org/33267] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2145166972_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/export-test/export-1689865939160, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/export-test/export-1689865939160/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:19,183 INFO [Listener at jenkins-hbase4.apache.org/33267] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:42063, inputRoot=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b, snapshotDir=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-07-20 15:12:19,191 INFO [Listener at jenkins-hbase4.apache.org/33267] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/export-test/export-1689865939160/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:19,218 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-20 15:12:19,219 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-20 15:12:19,220 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-20 15:12:19,220 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-20 15:12:19,220 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-20 15:12:19,221 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-20 15:12:19,221 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-20 15:12:19,302 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a3c136b5-559e-274b-8286-a02c66f74c8f/hadoop-8252421907223710352.jar 2023-07-20 15:12:19,303 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-20 15:12:19,304 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-20 15:12:19,304 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-20 15:12:19,305 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-20 15:12:19,305 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-20 15:12:19,305 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-20 15:12:19,306 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-20 15:12:19,306 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-20 15:12:19,307 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-20 15:12:19,308 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-20 15:12:19,308 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-20 15:12:19,309 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-20 15:12:19,309 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-20 15:12:19,309 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-20 15:12:19,310 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-20 15:12:19,311 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-20 15:12:19,311 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 15:12:19,312 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 15:12:19,312 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 15:12:19,312 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 15:12:19,313 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 15:12:19,313 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 15:12:19,314 DEBUG [Listener at jenkins-hbase4.apache.org/33267] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 15:12:20,268 WARN [Listener at jenkins-hbase4.apache.org/33267] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-20 15:12:20,271 INFO [Listener at jenkins-hbase4.apache.org/33267] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-07-20 15:12:20,273 DEBUG [Listener at jenkins-hbase4.apache.org/33267] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-07-20 15:12:22,113 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-20 15:12:22,113 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-20 15:12:22,118 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689865830265_0006_000001 (auth:SIMPLE) 2023-07-20 15:12:22,830 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-20 15:12:23,113 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689865830265_0007_000001 (auth:SIMPLE) 2023-07-20 15:12:29,918 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689865830265_0007_000001 (auth:SIMPLE) 2023-07-20 15:12:32,225 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689865830265_0007_000001 (auth:SIMPLE) 2023-07-20 15:12:36,426 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689865830265_0007_000001 (auth:SIMPLE) 2023-07-20 15:12:38,516 INFO [Listener at jenkins-hbase4.apache.org/33267] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-20 15:12:38,517 INFO [Listener at jenkins-hbase4.apache.org/33267] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-20 15:12:38,537 INFO [Listener at jenkins-hbase4.apache.org/33267] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:38,537 INFO [Listener at jenkins-hbase4.apache.org/33267] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-20 15:12:38,538 INFO [Listener at jenkins-hbase4.apache.org/33267] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-20 15:12:38,538 DEBUG [Listener at jenkins-hbase4.apache.org/33267] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_478830040_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:38,539 DEBUG [Listener at jenkins-hbase4.apache.org/33267] snapshot.TestExportSnapshot(367): hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-20 15:12:38,539 DEBUG [Listener at jenkins-hbase4.apache.org/33267] snapshot.TestExportSnapshot(367): hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-20 15:12:38,539 DEBUG [Listener at jenkins-hbase4.apache.org/33267] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_478830040_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/export-test/export-1689865939160/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/export-test/export-1689865939160/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:38,539 DEBUG [Listener at jenkins-hbase4.apache.org/33267] snapshot.TestExportSnapshot(367): hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/export-test/export-1689865939160/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-20 15:12:38,539 DEBUG [Listener at jenkins-hbase4.apache.org/33267] snapshot.TestExportSnapshot(367): hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/export-test/export-1689865939160/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-20 15:12:38,547 INFO [Listener at jenkins-hbase4.apache.org/33267] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:38,548 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:38,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] procedure2.ProcedureExecutor(1029): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:38,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-20 15:12:38,556 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689865958556"}]},"ts":"1689865958556"} 2023-07-20 15:12:38,563 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-07-20 15:12:38,567 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-07-20 15:12:38,569 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=562e13dad1e37a397190ef2ce91b2c6e, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=850ac635c6d75464c9459a49b686fcaa, UNASSIGN}] 2023-07-20 15:12:38,572 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=850ac635c6d75464c9459a49b686fcaa, UNASSIGN 2023-07-20 15:12:38,572 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=562e13dad1e37a397190ef2ce91b2c6e, UNASSIGN 2023-07-20 15:12:38,573 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=850ac635c6d75464c9459a49b686fcaa, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:12:38,573 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=562e13dad1e37a397190ef2ce91b2c6e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:12:38,573 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689865937535.850ac635c6d75464c9459a49b686fcaa.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689865958573"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689865958573"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689865958573"}]},"ts":"1689865958573"} 2023-07-20 15:12:38,574 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689865937535.562e13dad1e37a397190ef2ce91b2c6e.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689865958573"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689865958573"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689865958573"}]},"ts":"1689865958573"} 2023-07-20 15:12:38,576 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE; CloseRegionProcedure 850ac635c6d75464c9459a49b686fcaa, server=jenkins-hbase4.apache.org,41343,1689865822688}] 2023-07-20 15:12:38,577 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=118, ppid=115, state=RUNNABLE; CloseRegionProcedure 562e13dad1e37a397190ef2ce91b2c6e, server=jenkins-hbase4.apache.org,37315,1689865822568}] 2023-07-20 15:12:38,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-20 15:12:38,729 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 850ac635c6d75464c9459a49b686fcaa 2023-07-20 15:12:38,729 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 850ac635c6d75464c9459a49b686fcaa, disabling compactions & flushes 2023-07-20 15:12:38,729 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689865937535.850ac635c6d75464c9459a49b686fcaa. 2023-07-20 15:12:38,729 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689865937535.850ac635c6d75464c9459a49b686fcaa. 2023-07-20 15:12:38,729 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689865937535.850ac635c6d75464c9459a49b686fcaa. after waiting 0 ms 2023-07-20 15:12:38,729 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689865937535.850ac635c6d75464c9459a49b686fcaa. 2023-07-20 15:12:38,730 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 562e13dad1e37a397190ef2ce91b2c6e 2023-07-20 15:12:38,730 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 562e13dad1e37a397190ef2ce91b2c6e, disabling compactions & flushes 2023-07-20 15:12:38,730 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689865937535.562e13dad1e37a397190ef2ce91b2c6e. 2023-07-20 15:12:38,730 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689865937535.562e13dad1e37a397190ef2ce91b2c6e. 2023-07-20 15:12:38,730 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689865937535.562e13dad1e37a397190ef2ce91b2c6e. after waiting 0 ms 2023-07-20 15:12:38,730 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689865937535.562e13dad1e37a397190ef2ce91b2c6e. 2023-07-20 15:12:38,806 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportFileSystemStateWithSkipTmp/850ac635c6d75464c9459a49b686fcaa/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-20 15:12:38,807 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/default/testtb-testExportFileSystemStateWithSkipTmp/562e13dad1e37a397190ef2ce91b2c6e/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-20 15:12:38,807 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 15:12:38,809 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689865937535.850ac635c6d75464c9459a49b686fcaa. 2023-07-20 15:12:38,809 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 850ac635c6d75464c9459a49b686fcaa: 2023-07-20 15:12:38,809 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 15:12:38,811 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689865937535.562e13dad1e37a397190ef2ce91b2c6e. 2023-07-20 15:12:38,811 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 562e13dad1e37a397190ef2ce91b2c6e: 2023-07-20 15:12:38,818 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 562e13dad1e37a397190ef2ce91b2c6e 2023-07-20 15:12:38,818 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=562e13dad1e37a397190ef2ce91b2c6e, regionState=CLOSED 2023-07-20 15:12:38,818 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689865937535.562e13dad1e37a397190ef2ce91b2c6e.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689865958818"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689865958818"}]},"ts":"1689865958818"} 2023-07-20 15:12:38,819 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 850ac635c6d75464c9459a49b686fcaa 2023-07-20 15:12:38,820 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=850ac635c6d75464c9459a49b686fcaa, regionState=CLOSED 2023-07-20 15:12:38,821 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689865937535.850ac635c6d75464c9459a49b686fcaa.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689865958820"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689865958820"}]},"ts":"1689865958820"} 2023-07-20 15:12:38,823 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=115 2023-07-20 15:12:38,823 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=115, state=SUCCESS; CloseRegionProcedure 562e13dad1e37a397190ef2ce91b2c6e, server=jenkins-hbase4.apache.org,37315,1689865822568 in 243 msec 2023-07-20 15:12:38,824 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=562e13dad1e37a397190ef2ce91b2c6e, UNASSIGN in 254 msec 2023-07-20 15:12:38,825 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=116 2023-07-20 15:12:38,825 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=116, state=SUCCESS; CloseRegionProcedure 850ac635c6d75464c9459a49b686fcaa, server=jenkins-hbase4.apache.org,41343,1689865822688 in 246 msec 2023-07-20 15:12:38,828 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=116, resume processing ppid=114 2023-07-20 15:12:38,828 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=850ac635c6d75464c9459a49b686fcaa, UNASSIGN in 256 msec 2023-07-20 15:12:38,829 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689865958829"}]},"ts":"1689865958829"} 2023-07-20 15:12:38,830 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-07-20 15:12:38,832 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-07-20 15:12:38,834 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 285 msec 2023-07-20 15:12:38,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-20 15:12:38,859 INFO [Listener at jenkins-hbase4.apache.org/33267] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-07-20 15:12:38,860 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:38,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] procedure2.ProcedureExecutor(1029): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:38,864 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:38,865 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:38,866 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:38,872 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41343] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:38,873 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/562e13dad1e37a397190ef2ce91b2c6e 2023-07-20 15:12:38,875 DEBUG [HFileArchiver-23] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/850ac635c6d75464c9459a49b686fcaa 2023-07-20 15:12:38,876 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:38,876 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:38,876 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:38,876 DEBUG [HFileArchiver-22] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/562e13dad1e37a397190ef2ce91b2c6e/cf, FileablePath, hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/562e13dad1e37a397190ef2ce91b2c6e/recovered.edits] 2023-07-20 15:12:38,876 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:38,876 DEBUG [HFileArchiver-23] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/850ac635c6d75464c9459a49b686fcaa/cf, FileablePath, hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/850ac635c6d75464c9459a49b686fcaa/recovered.edits] 2023-07-20 15:12:38,877 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-20 15:12:38,877 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-20 15:12:38,877 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-20 15:12:38,878 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:38,878 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 15:12:38,878 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 15:12:38,878 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data null 2023-07-20 15:12:38,878 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-20 15:12:38,878 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:38,878 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 15:12:38,878 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:38,879 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 15:12:38,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-20 15:12:38,886 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/562e13dad1e37a397190ef2ce91b2c6e/cf/acf7f582d78243ed955375bf644e43e0 to hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/562e13dad1e37a397190ef2ce91b2c6e/cf/acf7f582d78243ed955375bf644e43e0 2023-07-20 15:12:38,889 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/850ac635c6d75464c9459a49b686fcaa/cf/b2c633d9f7814d3b81cb8bbe469401b5 to hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/850ac635c6d75464c9459a49b686fcaa/cf/b2c633d9f7814d3b81cb8bbe469401b5 2023-07-20 15:12:38,891 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/562e13dad1e37a397190ef2ce91b2c6e/recovered.edits/9.seqid to hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/562e13dad1e37a397190ef2ce91b2c6e/recovered.edits/9.seqid 2023-07-20 15:12:38,892 DEBUG [HFileArchiver-22] backup.HFileArchiver(596): Deleted hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/562e13dad1e37a397190ef2ce91b2c6e 2023-07-20 15:12:38,895 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/850ac635c6d75464c9459a49b686fcaa/recovered.edits/9.seqid to hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/850ac635c6d75464c9459a49b686fcaa/recovered.edits/9.seqid 2023-07-20 15:12:38,896 DEBUG [HFileArchiver-23] backup.HFileArchiver(596): Deleted hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/850ac635c6d75464c9459a49b686fcaa 2023-07-20 15:12:38,896 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-20 15:12:38,897 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-07-20 15:12:38,898 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-07-20 15:12:38,902 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202307203130a3a55df14eb99e823894962571d4 to hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202307203130a3a55df14eb99e823894962571d4 2023-07-20 15:12:38,904 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202307208d188d11a45e4790b2021d1e0dae8892 to hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202307208d188d11a45e4790b2021d1e0dae8892 2023-07-20 15:12:38,905 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-07-20 15:12:38,908 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:38,918 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-07-20 15:12:38,925 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-07-20 15:12:38,927 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:38,927 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-07-20 15:12:38,927 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689865937535.562e13dad1e37a397190ef2ce91b2c6e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689865958927"}]},"ts":"9223372036854775807"} 2023-07-20 15:12:38,927 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689865937535.850ac635c6d75464c9459a49b686fcaa.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689865958927"}]},"ts":"9223372036854775807"} 2023-07-20 15:12:38,932 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-20 15:12:38,932 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 562e13dad1e37a397190ef2ce91b2c6e, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689865937535.562e13dad1e37a397190ef2ce91b2c6e.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 850ac635c6d75464c9459a49b686fcaa, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689865937535.850ac635c6d75464c9459a49b686fcaa.', STARTKEY => '1', ENDKEY => ''}] 2023-07-20 15:12:38,932 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-07-20 15:12:38,932 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689865958932"}]},"ts":"9223372036854775807"} 2023-07-20 15:12:38,934 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-07-20 15:12:38,937 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:38,938 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 77 msec 2023-07-20 15:12:38,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-20 15:12:38,981 INFO [Listener at jenkins-hbase4.apache.org/33267] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-07-20 15:12:38,989 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-20 15:12:38,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:38,993 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-20 15:12:38,995 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38949] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:39,031 INFO [Listener at jenkins-hbase4.apache.org/33267] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=760 (was 760), OpenFileDescriptor=903 (was 910), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=739 (was 653) - SystemLoadAverage LEAK? -, ProcessCount=182 (was 185), AvailableMemoryMB=1842 (was 2056) 2023-07-20 15:12:39,031 WARN [Listener at jenkins-hbase4.apache.org/33267] hbase.ResourceChecker(130): Thread=760 is superior to 500 2023-07-20 15:12:39,031 INFO [Listener at jenkins-hbase4.apache.org/33267] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-07-20 15:12:39,044 INFO [Listener at jenkins-hbase4.apache.org/33267] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-20 15:12:42,639 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689865830265_0007_000001 (auth:SIMPLE) 2023-07-20 15:12:44,376 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-20 15:12:53,205 INFO [Listener at jenkins-hbase4.apache.org/33267] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-20 15:12:53,207 WARN [957391548@qtp-1349703639-1 - Acceptor0 HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:46335] http.HttpServer2$SelectChannelConnectorWithSafeStartup(546): HttpServer Acceptor: isRunning is false. Rechecking. 2023-07-20 15:12:53,207 WARN [957391548@qtp-1349703639-1 - Acceptor0 HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:46335] http.HttpServer2$SelectChannelConnectorWithSafeStartup(555): HttpServer Acceptor: isRunning is false 2023-07-20 15:13:07,329 ERROR [Thread[Thread-410,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-20 15:13:07,330 INFO [Listener at jenkins-hbase4.apache.org/33267] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-20 15:13:07,447 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-07-20 15:13:07,458 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-07-20 15:13:07,460 ERROR [Thread[Thread-420,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-20 15:13:07,473 INFO [Listener at jenkins-hbase4.apache.org/33267] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-20 15:13:07,577 ERROR [Thread[Thread-385,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-20 15:13:07,577 INFO [Listener at jenkins-hbase4.apache.org/33267] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-07-20 15:13:07,577 INFO [Listener at jenkins-hbase4.apache.org/33267] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-20 15:13:07,577 INFO [Listener at jenkins-hbase4.apache.org/33267] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-20 15:13:07,577 DEBUG [Listener at jenkins-hbase4.apache.org/33267] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x095b019e to 127.0.0.1:64446 2023-07-20 15:13:07,578 DEBUG [Listener at jenkins-hbase4.apache.org/33267] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 15:13:07,578 DEBUG [Listener at jenkins-hbase4.apache.org/33267] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-20 15:13:07,578 DEBUG [Listener at jenkins-hbase4.apache.org/33267] util.JVMClusterUtil(257): Found active master hash=1379146825, stopped=false 2023-07-20 15:13:07,578 DEBUG [Listener at jenkins-hbase4.apache.org/33267] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 15:13:07,579 DEBUG [Listener at jenkins-hbase4.apache.org/33267] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-20 15:13:07,579 INFO [Listener at jenkins-hbase4.apache.org/33267] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,38949,1689865821097 2023-07-20 15:13:07,580 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-20 15:13:07,580 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-20 15:13:07,580 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-20 15:13:07,580 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-20 15:13:07,580 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-20 15:13:07,580 INFO [Listener at jenkins-hbase4.apache.org/33267] procedure2.ProcedureExecutor(629): Stopping 2023-07-20 15:13:07,580 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-20 15:13:07,580 DEBUG [Listener at jenkins-hbase4.apache.org/33267] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0afc70eb to 127.0.0.1:64446 2023-07-20 15:13:07,581 DEBUG [Listener at jenkins-hbase4.apache.org/33267] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 15:13:07,581 INFO [Listener at jenkins-hbase4.apache.org/33267] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,37315,1689865822568' ***** 2023-07-20 15:13:07,581 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-20 15:13:07,581 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-20 15:13:07,581 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-20 15:13:07,582 DEBUG [Listener at jenkins-hbase4.apache.org/33267] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 15:13:07,582 INFO [RS:2;jenkins-hbase4:41343] regionserver.HRegionServer(1064): Closing user regions 2023-07-20 15:13:07,582 INFO [Listener at jenkins-hbase4.apache.org/33267] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-20 15:13:07,582 INFO [Listener at jenkins-hbase4.apache.org/33267] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,46155,1689865822636' ***** 2023-07-20 15:13:07,582 INFO [RS:2;jenkins-hbase4:41343] regionserver.HRegionServer(3305): Received CLOSE for e594665f61777c3f9ce0929d721f11f9 2023-07-20 15:13:07,582 DEBUG [Listener at jenkins-hbase4.apache.org/33267] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 15:13:07,582 INFO [Listener at jenkins-hbase4.apache.org/33267] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-20 15:13:07,582 INFO [Listener at jenkins-hbase4.apache.org/33267] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,41343,1689865822688' ***** 2023-07-20 15:13:07,582 DEBUG [Listener at jenkins-hbase4.apache.org/33267] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 15:13:07,582 INFO [Listener at jenkins-hbase4.apache.org/33267] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-20 15:13:07,582 INFO [RS:2;jenkins-hbase4:41343] regionserver.HRegionServer(3305): Received CLOSE for 798864104ad8a4db6af136e8938eb43e 2023-07-20 15:13:07,582 INFO [RS:1;jenkins-hbase4:46155] regionserver.HeapMemoryManager(220): Stopping 2023-07-20 15:13:07,582 INFO [RS:0;jenkins-hbase4:37315] regionserver.HeapMemoryManager(220): Stopping 2023-07-20 15:13:07,584 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-20 15:13:07,584 INFO [RS:0;jenkins-hbase4:37315] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-20 15:13:07,584 INFO [RS:1;jenkins-hbase4:46155] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-20 15:13:07,584 INFO [RS:0;jenkins-hbase4:37315] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-20 15:13:07,583 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e594665f61777c3f9ce0929d721f11f9, disabling compactions & flushes 2023-07-20 15:13:07,584 INFO [RS:0;jenkins-hbase4:37315] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:13:07,584 DEBUG [RS:0;jenkins-hbase4:37315] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5c807ec0 to 127.0.0.1:64446 2023-07-20 15:13:07,584 INFO [RS:2;jenkins-hbase4:41343] regionserver.HeapMemoryManager(220): Stopping 2023-07-20 15:13:07,584 INFO [RS:2;jenkins-hbase4:41343] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-20 15:13:07,584 INFO [RS:1;jenkins-hbase4:46155] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-20 15:13:07,584 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-20 15:13:07,584 INFO [RS:1;jenkins-hbase4:46155] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:13:07,584 INFO [RS:2;jenkins-hbase4:41343] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-20 15:13:07,584 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-20 15:13:07,585 INFO [RS:2;jenkins-hbase4:41343] regionserver.HRegionServer(3307): Received CLOSE for the region: 798864104ad8a4db6af136e8938eb43e, which we are already trying to CLOSE, but not completed yet 2023-07-20 15:13:07,585 INFO [RS:2;jenkins-hbase4:41343] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:13:07,584 DEBUG [RS:0;jenkins-hbase4:37315] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 15:13:07,584 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689865826331.e594665f61777c3f9ce0929d721f11f9. 2023-07-20 15:13:07,587 DEBUG [RS:2;jenkins-hbase4:41343] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3ce2dd49 to 127.0.0.1:64446 2023-07-20 15:13:07,585 DEBUG [RS:1;jenkins-hbase4:46155] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4ff95368 to 127.0.0.1:64446 2023-07-20 15:13:07,587 DEBUG [RS:1;jenkins-hbase4:46155] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 15:13:07,587 DEBUG [RS:2;jenkins-hbase4:41343] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 15:13:07,588 INFO [RS:0;jenkins-hbase4:37315] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-20 15:13:07,588 INFO [RS:1;jenkins-hbase4:46155] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,46155,1689865822636; all regions closed. 2023-07-20 15:13:07,587 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689865826331.e594665f61777c3f9ce0929d721f11f9. 2023-07-20 15:13:07,589 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689865826331.e594665f61777c3f9ce0929d721f11f9. after waiting 0 ms 2023-07-20 15:13:07,589 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689865826331.e594665f61777c3f9ce0929d721f11f9. 2023-07-20 15:13:07,589 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing e594665f61777c3f9ce0929d721f11f9 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-07-20 15:13:07,588 INFO [RS:0;jenkins-hbase4:37315] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-20 15:13:07,589 INFO [RS:2;jenkins-hbase4:41343] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-07-20 15:13:07,589 INFO [RS:0;jenkins-hbase4:37315] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-20 15:13:07,589 INFO [RS:0;jenkins-hbase4:37315] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-20 15:13:07,589 DEBUG [RS:2;jenkins-hbase4:41343] regionserver.HRegionServer(1478): Online Regions={e594665f61777c3f9ce0929d721f11f9=hbase:acl,,1689865826331.e594665f61777c3f9ce0929d721f11f9., 798864104ad8a4db6af136e8938eb43e=hbase:namespace,,1689865825469.798864104ad8a4db6af136e8938eb43e.} 2023-07-20 15:13:07,590 INFO [RS:0;jenkins-hbase4:37315] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-20 15:13:07,591 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-20 15:13:07,591 DEBUG [RS:0;jenkins-hbase4:37315] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-07-20 15:13:07,591 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-20 15:13:07,591 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-20 15:13:07,591 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-20 15:13:07,591 DEBUG [RS:2;jenkins-hbase4:41343] regionserver.HRegionServer(1504): Waiting on 798864104ad8a4db6af136e8938eb43e, e594665f61777c3f9ce0929d721f11f9 2023-07-20 15:13:07,591 DEBUG [RS:0;jenkins-hbase4:37315] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-20 15:13:07,591 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-20 15:13:07,591 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-07-20 15:13:07,606 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-20 15:13:07,623 DEBUG [RS:1;jenkins-hbase4:46155] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/oldWALs 2023-07-20 15:13:07,623 INFO [RS:1;jenkins-hbase4:46155] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C46155%2C1689865822636:(num 1689865824849) 2023-07-20 15:13:07,623 DEBUG [RS:1;jenkins-hbase4:46155] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 15:13:07,624 INFO [RS:1;jenkins-hbase4:46155] regionserver.LeaseManager(133): Closed leases 2023-07-20 15:13:07,625 INFO [RS:1;jenkins-hbase4:46155] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-20 15:13:07,625 INFO [RS:1;jenkins-hbase4:46155] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-20 15:13:07,625 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-20 15:13:07,625 INFO [RS:1;jenkins-hbase4:46155] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-20 15:13:07,626 INFO [RS:1;jenkins-hbase4:46155] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-20 15:13:07,633 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-20 15:13:07,637 INFO [RS:1;jenkins-hbase4:46155] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:46155 2023-07-20 15:13:07,637 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/hbase/meta/1588230740/.tmp/info/74ecf6549ee441878278b333eb4af40a 2023-07-20 15:13:07,638 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-20 15:13:07,640 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/hbase/acl/e594665f61777c3f9ce0929d721f11f9/.tmp/l/21a18fddace5437a8ee8134d1c3af3db 2023-07-20 15:13:07,643 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 74ecf6549ee441878278b333eb4af40a 2023-07-20 15:13:07,645 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 21a18fddace5437a8ee8134d1c3af3db 2023-07-20 15:13:07,646 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/hbase/acl/e594665f61777c3f9ce0929d721f11f9/.tmp/l/21a18fddace5437a8ee8134d1c3af3db as hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/hbase/acl/e594665f61777c3f9ce0929d721f11f9/l/21a18fddace5437a8ee8134d1c3af3db 2023-07-20 15:13:07,647 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:13:07,647 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:13:07,647 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-20 15:13:07,647 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-20 15:13:07,648 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-20 15:13:07,648 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,46155,1689865822636 2023-07-20 15:13:07,648 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-20 15:13:07,649 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,46155,1689865822636] 2023-07-20 15:13:07,650 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,46155,1689865822636; numProcessing=1 2023-07-20 15:13:07,652 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,46155,1689865822636 already deleted, retry=false 2023-07-20 15:13:07,652 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,46155,1689865822636 expired; onlineServers=2 2023-07-20 15:13:07,652 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 21a18fddace5437a8ee8134d1c3af3db 2023-07-20 15:13:07,653 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/hbase/acl/e594665f61777c3f9ce0929d721f11f9/l/21a18fddace5437a8ee8134d1c3af3db, entries=7, sequenceid=18, filesize=5.2 K 2023-07-20 15:13:07,653 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for e594665f61777c3f9ce0929d721f11f9 in 64ms, sequenceid=18, compaction requested=false 2023-07-20 15:13:07,659 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/hbase/acl/e594665f61777c3f9ce0929d721f11f9/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-07-20 15:13:07,660 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 15:13:07,661 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1689865826331.e594665f61777c3f9ce0929d721f11f9. 2023-07-20 15:13:07,661 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e594665f61777c3f9ce0929d721f11f9: 2023-07-20 15:13:07,661 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1689865826331.e594665f61777c3f9ce0929d721f11f9. 2023-07-20 15:13:07,661 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/hbase/meta/1588230740/.tmp/rep_barrier/690e27c38e4d43e590651f127f9da0ea 2023-07-20 15:13:07,662 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 798864104ad8a4db6af136e8938eb43e, disabling compactions & flushes 2023-07-20 15:13:07,662 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689865825469.798864104ad8a4db6af136e8938eb43e. 2023-07-20 15:13:07,662 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689865825469.798864104ad8a4db6af136e8938eb43e. 2023-07-20 15:13:07,662 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689865825469.798864104ad8a4db6af136e8938eb43e. after waiting 0 ms 2023-07-20 15:13:07,662 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689865825469.798864104ad8a4db6af136e8938eb43e. 2023-07-20 15:13:07,662 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 798864104ad8a4db6af136e8938eb43e 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-20 15:13:07,666 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 690e27c38e4d43e590651f127f9da0ea 2023-07-20 15:13:07,670 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-20 15:13:07,671 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-20 15:13:07,677 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/hbase/namespace/798864104ad8a4db6af136e8938eb43e/.tmp/info/22ef643c3b5b495ca66bc5d5fc91ae3c 2023-07-20 15:13:07,681 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/hbase/meta/1588230740/.tmp/table/77020f94555545dd800db19356b595b2 2023-07-20 15:13:07,681 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/hbase/namespace/798864104ad8a4db6af136e8938eb43e/.tmp/info/22ef643c3b5b495ca66bc5d5fc91ae3c as hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/hbase/namespace/798864104ad8a4db6af136e8938eb43e/info/22ef643c3b5b495ca66bc5d5fc91ae3c 2023-07-20 15:13:07,703 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 77020f94555545dd800db19356b595b2 2023-07-20 15:13:07,704 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/hbase/namespace/798864104ad8a4db6af136e8938eb43e/info/22ef643c3b5b495ca66bc5d5fc91ae3c, entries=2, sequenceid=6, filesize=4.8 K 2023-07-20 15:13:07,704 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/hbase/meta/1588230740/.tmp/info/74ecf6549ee441878278b333eb4af40a as hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/hbase/meta/1588230740/info/74ecf6549ee441878278b333eb4af40a 2023-07-20 15:13:07,705 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 798864104ad8a4db6af136e8938eb43e in 43ms, sequenceid=6, compaction requested=false 2023-07-20 15:13:07,710 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/hbase/namespace/798864104ad8a4db6af136e8938eb43e/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-20 15:13:07,710 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 74ecf6549ee441878278b333eb4af40a 2023-07-20 15:13:07,711 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 15:13:07,711 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/hbase/meta/1588230740/info/74ecf6549ee441878278b333eb4af40a, entries=48, sequenceid=131, filesize=10.3 K 2023-07-20 15:13:07,711 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689865825469.798864104ad8a4db6af136e8938eb43e. 2023-07-20 15:13:07,711 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 798864104ad8a4db6af136e8938eb43e: 2023-07-20 15:13:07,711 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689865825469.798864104ad8a4db6af136e8938eb43e. 2023-07-20 15:13:07,712 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/hbase/meta/1588230740/.tmp/rep_barrier/690e27c38e4d43e590651f127f9da0ea as hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/hbase/meta/1588230740/rep_barrier/690e27c38e4d43e590651f127f9da0ea 2023-07-20 15:13:07,715 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 690e27c38e4d43e590651f127f9da0ea 2023-07-20 15:13:07,715 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/hbase/meta/1588230740/rep_barrier/690e27c38e4d43e590651f127f9da0ea, entries=13, sequenceid=131, filesize=6.4 K 2023-07-20 15:13:07,716 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/hbase/meta/1588230740/.tmp/table/77020f94555545dd800db19356b595b2 as hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/hbase/meta/1588230740/table/77020f94555545dd800db19356b595b2 2023-07-20 15:13:07,720 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 77020f94555545dd800db19356b595b2 2023-07-20 15:13:07,720 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/hbase/meta/1588230740/table/77020f94555545dd800db19356b595b2, entries=24, sequenceid=131, filesize=6.9 K 2023-07-20 15:13:07,721 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 130ms, sequenceid=131, compaction requested=false 2023-07-20 15:13:07,730 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-07-20 15:13:07,730 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 15:13:07,730 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-20 15:13:07,731 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-20 15:13:07,731 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-20 15:13:07,731 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-20 15:13:07,738 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-20 15:13:07,738 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-20 15:13:07,751 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-20 15:13:07,751 INFO [RS:1;jenkins-hbase4:46155] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,46155,1689865822636; zookeeper connection closed. 2023-07-20 15:13:07,751 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:46155-0x10183489abc0002, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-20 15:13:07,751 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@1e7d4b14] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@1e7d4b14 2023-07-20 15:13:07,791 INFO [RS:2;jenkins-hbase4:41343] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,41343,1689865822688; all regions closed. 2023-07-20 15:13:07,791 INFO [RS:0;jenkins-hbase4:37315] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,37315,1689865822568; all regions closed. 2023-07-20 15:13:07,799 DEBUG [RS:2;jenkins-hbase4:41343] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/oldWALs 2023-07-20 15:13:07,799 INFO [RS:2;jenkins-hbase4:41343] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C41343%2C1689865822688:(num 1689865824851) 2023-07-20 15:13:07,799 DEBUG [RS:0;jenkins-hbase4:37315] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/oldWALs 2023-07-20 15:13:07,800 DEBUG [RS:2;jenkins-hbase4:41343] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 15:13:07,800 INFO [RS:0;jenkins-hbase4:37315] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C37315%2C1689865822568.meta:.meta(num 1689865825053) 2023-07-20 15:13:07,800 INFO [RS:2;jenkins-hbase4:41343] regionserver.LeaseManager(133): Closed leases 2023-07-20 15:13:07,800 INFO [RS:2;jenkins-hbase4:41343] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-20 15:13:07,801 INFO [RS:2;jenkins-hbase4:41343] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-20 15:13:07,801 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-20 15:13:07,801 INFO [RS:2;jenkins-hbase4:41343] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-20 15:13:07,801 INFO [RS:2;jenkins-hbase4:41343] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-20 15:13:07,802 INFO [RS:2;jenkins-hbase4:41343] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:41343 2023-07-20 15:13:07,808 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:13:07,808 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,41343,1689865822688 2023-07-20 15:13:07,809 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-20 15:13:07,809 DEBUG [RS:0;jenkins-hbase4:37315] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/oldWALs 2023-07-20 15:13:07,809 INFO [RS:0;jenkins-hbase4:37315] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C37315%2C1689865822568:(num 1689865824849) 2023-07-20 15:13:07,809 DEBUG [RS:0;jenkins-hbase4:37315] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 15:13:07,809 INFO [RS:0;jenkins-hbase4:37315] regionserver.LeaseManager(133): Closed leases 2023-07-20 15:13:07,810 INFO [RS:0;jenkins-hbase4:37315] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-20 15:13:07,811 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-20 15:13:07,811 INFO [RS:0;jenkins-hbase4:37315] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:37315 2023-07-20 15:13:07,811 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,41343,1689865822688] 2023-07-20 15:13:07,811 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,41343,1689865822688; numProcessing=2 2023-07-20 15:13:07,812 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-20 15:13:07,812 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,41343,1689865822688 already deleted, retry=false 2023-07-20 15:13:07,812 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,41343,1689865822688 expired; onlineServers=1 2023-07-20 15:13:07,813 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37315,1689865822568 2023-07-20 15:13:07,813 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,37315,1689865822568] 2023-07-20 15:13:07,815 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,37315,1689865822568; numProcessing=3 2023-07-20 15:13:07,817 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,37315,1689865822568 already deleted, retry=false 2023-07-20 15:13:07,817 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,37315,1689865822568 expired; onlineServers=0 2023-07-20 15:13:07,817 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,38949,1689865821097' ***** 2023-07-20 15:13:07,817 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-20 15:13:07,817 DEBUG [M:0;jenkins-hbase4:38949] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@13091672, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-20 15:13:07,817 INFO [M:0;jenkins-hbase4:38949] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,38949,1689865821097 2023-07-20 15:13:07,817 INFO [M:0;jenkins-hbase4:38949] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,38949,1689865821097; all regions closed. 2023-07-20 15:13:07,817 DEBUG [M:0;jenkins-hbase4:38949] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 15:13:07,818 DEBUG [M:0;jenkins-hbase4:38949] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-20 15:13:07,818 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-20 15:13:07,818 DEBUG [M:0;jenkins-hbase4:38949] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-20 15:13:07,818 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689865824331] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689865824331,5,FailOnTimeoutGroup] 2023-07-20 15:13:07,818 INFO [M:0;jenkins-hbase4:38949] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-20 15:13:07,818 INFO [M:0;jenkins-hbase4:38949] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-20 15:13:07,818 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689865824319] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689865824319,5,FailOnTimeoutGroup] 2023-07-20 15:13:07,818 INFO [M:0;jenkins-hbase4:38949] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-07-20 15:13:07,818 DEBUG [M:0;jenkins-hbase4:38949] master.HMaster(1512): Stopping service threads 2023-07-20 15:13:07,818 INFO [M:0;jenkins-hbase4:38949] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-20 15:13:07,819 ERROR [M:0;jenkins-hbase4:38949] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-22,5,PEWorkerGroup] Thread[HFileArchiver-23,5,PEWorkerGroup] 2023-07-20 15:13:07,819 INFO [M:0;jenkins-hbase4:38949] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-20 15:13:07,819 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-20 15:13:07,820 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-20 15:13:07,820 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-20 15:13:07,820 DEBUG [M:0;jenkins-hbase4:38949] zookeeper.ZKUtil(398): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-20 15:13:07,820 WARN [M:0;jenkins-hbase4:38949] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-20 15:13:07,820 INFO [M:0;jenkins-hbase4:38949] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-20 15:13:07,820 INFO [M:0;jenkins-hbase4:38949] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-20 15:13:07,821 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-20 15:13:07,821 DEBUG [M:0;jenkins-hbase4:38949] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-20 15:13:07,821 INFO [M:0;jenkins-hbase4:38949] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-20 15:13:07,821 DEBUG [M:0;jenkins-hbase4:38949] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-20 15:13:07,821 DEBUG [M:0;jenkins-hbase4:38949] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-20 15:13:07,821 DEBUG [M:0;jenkins-hbase4:38949] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-20 15:13:07,821 INFO [M:0;jenkins-hbase4:38949] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=375.65 KB heapSize=451.87 KB 2023-07-20 15:13:07,872 INFO [M:0;jenkins-hbase4:38949] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=375.65 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/5a25c4ae99fb403e9c62953de024d2ed 2023-07-20 15:13:07,877 INFO [M:0;jenkins-hbase4:38949] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5a25c4ae99fb403e9c62953de024d2ed 2023-07-20 15:13:07,878 DEBUG [M:0;jenkins-hbase4:38949] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/5a25c4ae99fb403e9c62953de024d2ed as hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/5a25c4ae99fb403e9c62953de024d2ed 2023-07-20 15:13:07,883 INFO [M:0;jenkins-hbase4:38949] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5a25c4ae99fb403e9c62953de024d2ed 2023-07-20 15:13:07,883 INFO [M:0;jenkins-hbase4:38949] regionserver.HStore(1080): Added hdfs://localhost:42063/user/jenkins/test-data/625184c7-d90a-1a07-ad88-bbe302fbdf8b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/5a25c4ae99fb403e9c62953de024d2ed, entries=119, sequenceid=899, filesize=28.6 K 2023-07-20 15:13:07,884 INFO [M:0;jenkins-hbase4:38949] regionserver.HRegion(2948): Finished flush of dataSize ~375.65 KB/384661, heapSize ~451.85 KB/462696, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 63ms, sequenceid=899, compaction requested=false 2023-07-20 15:13:07,887 INFO [M:0;jenkins-hbase4:38949] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-20 15:13:07,887 DEBUG [M:0;jenkins-hbase4:38949] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-20 15:13:07,895 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-20 15:13:07,896 INFO [M:0;jenkins-hbase4:38949] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-20 15:13:07,896 INFO [M:0;jenkins-hbase4:38949] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:38949 2023-07-20 15:13:07,899 DEBUG [M:0;jenkins-hbase4:38949] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,38949,1689865821097 already deleted, retry=false 2023-07-20 15:13:07,910 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-20 15:13:07,910 INFO [RS:2;jenkins-hbase4:41343] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,41343,1689865822688; zookeeper connection closed. 2023-07-20 15:13:07,910 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:41343-0x10183489abc0003, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-20 15:13:07,910 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@7c4d4c15] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@7c4d4c15 2023-07-20 15:13:08,010 INFO [M:0;jenkins-hbase4:38949] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,38949,1689865821097; zookeeper connection closed. 2023-07-20 15:13:08,010 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-20 15:13:08,010 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): master:38949-0x10183489abc0000, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-20 15:13:08,110 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-20 15:13:08,110 INFO [RS:0;jenkins-hbase4:37315] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,37315,1689865822568; zookeeper connection closed. 2023-07-20 15:13:08,110 DEBUG [Listener at localhost/33785-EventThread] zookeeper.ZKWatcher(600): regionserver:37315-0x10183489abc0001, quorum=127.0.0.1:64446, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-20 15:13:08,110 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@3b85227d] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@3b85227d 2023-07-20 15:13:08,111 INFO [Listener at jenkins-hbase4.apache.org/33267] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-20 15:13:08,111 WARN [Listener at jenkins-hbase4.apache.org/33267] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-20 15:13:08,114 INFO [Listener at jenkins-hbase4.apache.org/33267] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-20 15:13:08,219 WARN [BP-1007504273-172.31.14.131-1689865817140 heartbeating to localhost/127.0.0.1:42063] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-20 15:13:08,219 WARN [BP-1007504273-172.31.14.131-1689865817140 heartbeating to localhost/127.0.0.1:42063] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1007504273-172.31.14.131-1689865817140 (Datanode Uuid dae96c8b-cb40-4abf-a0f6-f97c5601ee90) service to localhost/127.0.0.1:42063 2023-07-20 15:13:08,221 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a3c136b5-559e-274b-8286-a02c66f74c8f/cluster_7c972e76-1c0e-2046-c767-99afc843fe90/dfs/data/data5/current/BP-1007504273-172.31.14.131-1689865817140] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-20 15:13:08,221 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a3c136b5-559e-274b-8286-a02c66f74c8f/cluster_7c972e76-1c0e-2046-c767-99afc843fe90/dfs/data/data6/current/BP-1007504273-172.31.14.131-1689865817140] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-20 15:13:08,223 WARN [Listener at jenkins-hbase4.apache.org/33267] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-20 15:13:08,231 INFO [Listener at jenkins-hbase4.apache.org/33267] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-20 15:13:08,334 WARN [BP-1007504273-172.31.14.131-1689865817140 heartbeating to localhost/127.0.0.1:42063] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-20 15:13:08,334 WARN [BP-1007504273-172.31.14.131-1689865817140 heartbeating to localhost/127.0.0.1:42063] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1007504273-172.31.14.131-1689865817140 (Datanode Uuid f813a2d3-8503-43f5-ac0f-6ea6d6af1556) service to localhost/127.0.0.1:42063 2023-07-20 15:13:08,335 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a3c136b5-559e-274b-8286-a02c66f74c8f/cluster_7c972e76-1c0e-2046-c767-99afc843fe90/dfs/data/data3/current/BP-1007504273-172.31.14.131-1689865817140] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-20 15:13:08,335 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a3c136b5-559e-274b-8286-a02c66f74c8f/cluster_7c972e76-1c0e-2046-c767-99afc843fe90/dfs/data/data4/current/BP-1007504273-172.31.14.131-1689865817140] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-20 15:13:08,336 WARN [Listener at jenkins-hbase4.apache.org/33267] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-20 15:13:08,342 INFO [Listener at jenkins-hbase4.apache.org/33267] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-20 15:13:08,345 WARN [BP-1007504273-172.31.14.131-1689865817140 heartbeating to localhost/127.0.0.1:42063] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-20 15:13:08,345 WARN [BP-1007504273-172.31.14.131-1689865817140 heartbeating to localhost/127.0.0.1:42063] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1007504273-172.31.14.131-1689865817140 (Datanode Uuid f3b1399c-2b99-4424-9046-34dfc9697777) service to localhost/127.0.0.1:42063 2023-07-20 15:13:08,346 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a3c136b5-559e-274b-8286-a02c66f74c8f/cluster_7c972e76-1c0e-2046-c767-99afc843fe90/dfs/data/data1/current/BP-1007504273-172.31.14.131-1689865817140] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-20 15:13:08,347 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/a3c136b5-559e-274b-8286-a02c66f74c8f/cluster_7c972e76-1c0e-2046-c767-99afc843fe90/dfs/data/data2/current/BP-1007504273-172.31.14.131-1689865817140] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-20 15:13:08,368 INFO [Listener at jenkins-hbase4.apache.org/33267] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-20 15:13:08,497 INFO [Listener at jenkins-hbase4.apache.org/33267] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-20 15:13:08,624 INFO [Listener at jenkins-hbase4.apache.org/33267] hbase.HBaseTestingUtility(1293): Minicluster is down